-- Logs begin at Thu 2022-07-28 05:44:27 UTC, end at Thu 2022-07-28 06:56:23 UTC. -- Jul 28 06:28:05.822341 dv-cinder-850605-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 06:28:05.830032 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 06:28:05 2022] *** Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: nodename: dv-cinder-850605-1-iscsi Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: machine: x86_64 Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: clock source: unix Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: pcre jit disabled Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: detected number of CPU cores: 4 Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: current working directory: / Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: detected binary path: /usr/bin/uwsgi-core Jul 28 06:28:05.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: your processes number limit is 47680 Jul 28 06:28:05.833396 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: your memory page size is 4096 bytes Jul 28 06:28:05.833396 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: detected max file descriptor number: 2048 Jul 28 06:28:05.833396 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: lock engine: pthread robust mutexes Jul 28 06:28:05.833396 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: thunder lock: enabled Jul 28 06:28:05.833396 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 06:28:05.833396 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 06:28:05.872693 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: Python main interpreter initialized at 0x556bde0879c0 Jul 28 06:28:05.872693 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: python threads support enabled Jul 28 06:28:05.872693 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: your server socket listen backlog is limited to 100 connections Jul 28 06:28:05.872693 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: your mercy for graceful operations on workers is 90 seconds Jul 28 06:28:05.873046 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 06:28:05.873136 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: *** Operational MODE: preforking *** Jul 28 06:28:05.873378 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: *** uWSGI is running in multiple interpreter mode *** Jul 28 06:28:05.873378 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: spawned uWSGI master process (pid: 103526) Jul 28 06:28:05.873565 dv-cinder-850605-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 06:28:05.874128 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: spawned uWSGI worker 1 (pid: 103527, cores: 1) Jul 28 06:28:05.877171 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: spawned uWSGI worker 2 (pid: 103528, cores: 1) Jul 28 06:28:05.877171 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 06:28:06.533008 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 06:28:06.552032 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 06:28:07.630043 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:28:07.630043 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: from cryptography.utils import int_from_bytes Jul 28 06:28:07.630739 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:28:07.630739 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: from cryptography.utils import int_from_bytes Jul 28 06:28:07.662240 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:28:07.662240 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: from cryptography.utils import int_from_bytes Jul 28 06:28:07.662754 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:28:07.662754 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: from cryptography.utils import int_from_bytes Jul 28 06:28:10.130813 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 06:28:10.131471 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 06:28:10.131823 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 06:28:10.131922 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 06:28:10.132006 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 06:28:10.132085 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 06:28:10.132172 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 06:28:10.132252 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 06:28:10.132340 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 06:28:10.132408 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 06:28:10.132546 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.132639 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.132859 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.132956 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.133248 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.133417 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.133623 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.133735 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.133956 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.134070 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.134340 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.134441 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.134582 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.134682 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.134900 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.134986 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.135227 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.135310 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.135490 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.135575 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.135804 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.135895 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.136126 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850605-1-iscsi {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.136217 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850605-1-iscsi {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.136446 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.136532 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.136753 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.136849 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.137061 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.137156 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.137405 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.137509 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.137714 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.137849 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.138033 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.138160 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.138344 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.138491 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.138843 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.138966 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.139281 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.139434 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.139591 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.139756 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.139895 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.140032 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.140221 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.140644 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.140862 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.141015 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.141227 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.141449 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.141602 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.141813 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.142008 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.142165 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.142377 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.142527 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.142750 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.142938 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.143125 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850605-1-iscsi {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.143320 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850605-1-iscsi {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.143516 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.143708 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.143864 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.144040 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.144248 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.144445 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.144602 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.144834 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.145018 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.145300 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.145430 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.145579 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.145717 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.145841 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.145998 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.146133 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.146256 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.146377 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.146507 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.146660 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.146885 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.147021 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.147146 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.147275 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.147399 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.147530 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.147662 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.147786 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.147915 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.148067 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.148192 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.148326 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.148473 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.148666 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.148912 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.149044 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.149175 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.149330 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.149462 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.149571 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.149678 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.149789 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.149974 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.150189 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.150399 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.150589 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.150847 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.150847 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.151072 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.151189 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.151297 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.151297 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.151661 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.151857 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.152064 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.152303 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.152432 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.152562 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.152686 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.152686 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.152934 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.153062 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.153185 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.153328 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.153468 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.153608 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.153732 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.153855 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.153977 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.154109 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.154233 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.154368 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.154500 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.154623 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.154770 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.154904 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.155028 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.155163 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.155294 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.155424 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.155547 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.155547 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.155777 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.155777 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.156019 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.156141 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.156271 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.156424 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.156557 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.156681 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.156812 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.156935 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.157065 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.157188 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.157365 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.157491 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.157613 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.157735 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.157856 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.157978 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.158114 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.158246 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.158369 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.158498 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.158621 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.158770 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.158907 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.159031 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.159153 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.159282 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.159406 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.159541 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.159665 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.159787 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.159909 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.160034 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.160157 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.160287 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.160418 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.160547 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.160670 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.160791 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.160983 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.161119 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.161308 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.161456 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.161614 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.161741 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.161922 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.162058 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.162231 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.162358 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.162540 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.162695 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.162839 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.162977 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.163144 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.163273 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.163448 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.163575 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.163749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.163877 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.164053 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.164177 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.164879 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.165020 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.165249 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.165408 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.165587 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.165727 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.165894 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.166034 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.166200 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.166334 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.166520 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.166653 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.166826 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.166955 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.167132 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.167269 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.167452 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.167577 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.167754 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.167878 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.168059 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.168186 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.168371 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.168503 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.168673 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.168806 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.168978 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.169105 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.169286 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.169443 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.169611 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.169736 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.169917 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.170044 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.170222 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.170347 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.170527 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.170653 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.170854 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.170983 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.171114 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.171237 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.171412 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.171552 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.171716 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.171842 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.172020 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.172144 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.172319 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.172454 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.172623 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.172750 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.172919 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.173052 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.173221 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.173437 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.173564 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.173686 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.173857 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.173991 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.174161 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.174298 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.174466 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.174599 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.174775 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.174918 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.175085 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.175218 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.175407 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:28:10.175535 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.175745 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.175873 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.176065 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.176191 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.176397 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.176527 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.176723 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.176847 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.177039 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.177173 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.177371 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.177498 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.177686 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.177824 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.178013 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.178139 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.178322 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.178455 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.178633 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.178768 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.178946 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.179072 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.179257 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.179382 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.179571 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.179705 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.179888 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.181047 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.181209 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.181357 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.181482 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.181619 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.181746 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.181870 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.181999 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.182125 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.182248 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.182419 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.182559 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.182691 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.182822 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.182945 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.183067 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.183208 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.183323 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.183444 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.183573 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.183697 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.183920 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.184049 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.184268 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.184394 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.184581 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.184706 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.184890 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.185017 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.185200 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.185396 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.185521 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.185656 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.185848 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.185976 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.186164 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.186290 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.186470 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.186596 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.186782 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.186911 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.187086 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.187214 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.187395 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.187525 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.187704 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.187831 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.188012 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.188132 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.188321 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.188457 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.188631 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.188756 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.188944 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.189062 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.189256 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.189419 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.189589 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.189716 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.189905 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.190031 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.190215 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.190347 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.190521 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.190654 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.190830 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.190955 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.191134 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.191269 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.191437 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.191563 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.191740 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.191863 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.192045 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.192170 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.192347 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.192473 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.192654 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.192787 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.192962 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.193082 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.193268 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.193405 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.193624 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.193750 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.193956 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.194085 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.194216 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.194340 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.194518 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.194652 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.194828 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.194956 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.195132 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.195266 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.195442 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.195715 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.195884 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.196008 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.196140 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.196264 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.196443 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.196836 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.197018 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.197145 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.197373 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.197501 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.197687 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.197828 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.197995 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.198128 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.198299 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.198431 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.198616 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.198750 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.198931 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.199066 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.199233 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.199366 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.199544 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.199677 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.199854 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.199981 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.200166 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.200291 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.200479 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.200612 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.200791 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.200918 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.201106 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.201230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.201446 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.201575 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.201760 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.201885 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.202089 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.202217 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.202397 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.202523 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.202714 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.202839 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.203019 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.203374 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.203498 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.203622 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.203745 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.203867 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.203997 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.204134 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.204260 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.204391 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.204523 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.204647 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.204769 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.204901 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.205065 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.205196 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.205393 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.205521 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.205701 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.205841 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.206004 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.206132 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.206327 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.206454 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.206637 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.206769 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.206937 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.207071 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.207239 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.207367 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.207542 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.207680 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.207851 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.207989 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.208156 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.208283 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.208501 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.208638 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.208806 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.208932 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.209140 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.209272 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.209487 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.209624 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.209800 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.209926 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.210115 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.210253 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.210427 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.210553 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.210737 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.210862 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.211046 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.211203 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.211398 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.211526 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.211746 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.211871 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.212058 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.212195 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.212376 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.212503 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.212685 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.212812 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.213010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.213150 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.213347 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.213478 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.213670 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.213797 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.213974 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.214119 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.214290 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.214417 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.214596 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.214730 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.214914 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.215050 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.215249 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.215376 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.215577 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.215705 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.215886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.216022 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.216200 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.216326 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.216509 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.216637 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.216814 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.216941 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.217123 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.217258 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.217457 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.217596 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.217767 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.217895 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.218075 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.218207 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.218393 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.218529 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.218701 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.218828 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.219019 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.219145 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.219325 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.219459 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.219642 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.219775 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.219945 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.220072 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.220257 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.220393 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.220561 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.220686 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.220878 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.221008 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.221199 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.221383 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.221533 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.221660 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.221856 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.221992 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.222167 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.222302 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.222474 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.222606 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.222784 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.222910 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.223111 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.223238 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.223380 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.223514 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.223684 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.223815 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.223991 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.224120 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.224298 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.224426 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.224606 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.224741 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.224912 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.225039 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.225221 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.225364 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.225556 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.225684 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.225856 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.225983 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.226161 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.226287 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.226464 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.226598 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.226772 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.227512 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.227818 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.227955 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.228206 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.228372 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.228527 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.228856 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.228983 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.229184 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.229470 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.229616 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.229816 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.229994 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.230129 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.230445 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.230580 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.230755 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.231035 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.231168 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.231354 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.231526 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.231700 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.232013 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.232147 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.232319 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.232498 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.232627 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.232945 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.233080 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.233258 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.233548 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.233677 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.233902 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.234036 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.234214 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.234516 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.234643 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.234844 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.235020 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.235156 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.235453 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.235588 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.235768 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.235995 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.236131 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.236379 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.236505 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.236705 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.236953 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.237079 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.237339 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.237478 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.237661 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.237971 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.238111 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.238282 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.238461 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.238624 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.238949 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.239163 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.239436 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.239564 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.239802 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.239929 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.240126 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.240389 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.240517 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.240756 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.240884 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.241090 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.241405 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.241534 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.241775 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.241919 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.242086 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.242371 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.243086 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.243344 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.243470 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.243656 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.243886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.244016 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.244269 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.244402 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.244578 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.244888 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.245202 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.245370 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.245536 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.245770 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.245906 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.246137 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.246273 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.246445 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.246757 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.246891 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.247064 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.247257 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.247393 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.247678 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.247870 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.247996 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.248259 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.248400 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.248597 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.248772 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.248900 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.249194 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.249339 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.249567 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.249793 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.249922 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.250200 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.250327 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.250533 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.250749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.250885 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.251174 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.251307 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.251483 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.251699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.251825 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.252105 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.252232 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.252407 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.252638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.252767 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.253010 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.253213 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.253371 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.253627 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.253762 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.253947 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.254109 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.254258 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.254569 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.254695 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.254879 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.255055 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.255191 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.255477 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.255603 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.255784 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.256022 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.256149 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.256396 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.256523 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.256700 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.256994 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.257121 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.257337 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.257507 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.257638 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.257934 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.258092 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.258383 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.258520 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.258771 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.258990 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.259117 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.259395 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.259521 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.259703 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.259933 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.260061 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.260309 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.260471 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.260620 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.260926 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.261053 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.261252 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.261491 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.261631 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.261888 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.262023 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.262196 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.262507 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.262634 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.262815 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.263008 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.263137 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.263419 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.263544 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.263744 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.263871 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.264061 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.264190 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.264366 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.264493 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.264675 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.264801 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.264978 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.265105 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.265283 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.265452 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.265611 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.265747 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.265922 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.266052 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.266226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.266353 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.266530 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.266667 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.266834 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.266974 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.267137 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.267265 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.267447 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.267584 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.267771 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.267986 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.268117 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.268373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.268499 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.268678 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.268933 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.269061 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.269334 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.269463 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.269645 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.269897 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.270033 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.270304 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.270438 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.270622 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.270837 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.270965 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.271243 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.271377 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.271557 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.271766 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.271902 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.272167 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.272300 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.272485 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.272702 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.272829 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.273099 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.273233 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.273429 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.274176 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.274303 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.274594 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.274734 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.275015 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.275209 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.275336 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.275610 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.275745 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.275925 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.276051 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.276259 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.276394 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.276573 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.276709 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.276885 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.277011 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.277197 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.277355 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.277536 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.277674 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.277851 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.277987 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.278164 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.278290 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.278475 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.278610 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.278789 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.278916 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.279103 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.279237 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.279417 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.279569 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.279730 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.280038 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.280171 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.280351 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.280487 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.280666 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.280955 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.281089 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.281336 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.281464 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.281627 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.281915 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.282044 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.282236 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.282385 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.282544 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.282856 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.282986 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.283163 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.283324 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.283598 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.283794 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.283923 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.284213 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.284346 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.284523 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.284740 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.284880 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.285135 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.285268 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.285478 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.285735 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.285861 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.286092 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.286247 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.286516 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.286754 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.286887 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.287111 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.287317 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.287444 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.287574 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.287729 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.287854 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.288043 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.288171 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.288356 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.288483 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.288684 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.288811 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.288994 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.289122 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.289922 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.290059 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.290252 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.290381 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.290585 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.290749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.290898 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.291136 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.291264 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.291620 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.291760 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.291943 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.292108 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.292257 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.292582 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.292723 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.292984 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.293110 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.293324 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.293568 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.293695 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.293965 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.294093 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.294296 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.294515 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.294641 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.294917 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.295050 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.295231 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.295492 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.295627 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.295873 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.296005 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.296186 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.296463 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.296592 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.296800 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.296924 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.297127 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.297439 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.297571 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.297792 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.297977 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.298127 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.298519 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.298648 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.298853 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.298979 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.299165 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.299291 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.299482 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.299609 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.299800 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.299928 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.300106 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.300230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.300413 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.300548 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.300729 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.300855 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.301036 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.301176 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.301369 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.301498 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.301690 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.301829 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.301997 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.302131 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.302311 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.302439 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.302624 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.302799 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.302926 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.303229 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.303363 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.303535 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.303729 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.303858 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.304155 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.304290 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.304481 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.304662 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.304795 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.305331 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.305474 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.305759 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.305889 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.306075 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.306329 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.306467 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.306707 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.306841 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.307016 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.307264 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.307397 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.307620 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.307746 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.307975 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.308215 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.308344 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.308594 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.308726 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.308929 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.309210 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.309376 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.309590 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.309929 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.310056 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.310259 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.310394 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.310579 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.310838 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.310974 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.311216 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.311342 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.311522 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.311663 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.311829 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.311957 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.312144 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.312272 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.312452 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.312588 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.312760 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.312888 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.313067 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.313195 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.313380 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.313515 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.313696 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.313830 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.314003 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.314137 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.314305 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.314441 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.314631 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.314758 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.314938 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.315065 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.315264 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.315394 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.315575 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.315742 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.315869 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.316056 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.316184 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.316367 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.316503 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.316691 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.316820 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.317014 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.317142 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.317373 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.317504 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.317683 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.317813 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.318001 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.318130 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.318312 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.318440 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.318637 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.318764 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.318961 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.319090 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.319272 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.319409 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.319588 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.319726 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.319895 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.320024 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.320212 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.320347 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.320530 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.321154 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.321154 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.321475 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.321872 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.321998 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.321998 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.322245 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.322371 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.322494 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.322617 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.322741 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.322864 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.322996 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.323128 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.323251 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.323416 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.323553 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.323723 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.323852 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.324036 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.324163 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.324368 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.324509 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.324648 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.324775 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.324955 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.325083 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.325261 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.325413 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.325605 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.325733 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.325916 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.326043 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.326225 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.326361 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.326530 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.326657 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.326833 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.326969 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.327156 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.327292 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.327462 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.327602 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.327786 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.327915 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.328098 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.328234 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.328424 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.328550 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.328740 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.328868 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.329043 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.329169 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.329388 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.329529 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.329699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.329834 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.330002 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.330130 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.330306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.330432 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.330608 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.330738 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.330936 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.331065 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.331242 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.331367 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.331557 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.331695 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.331873 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.332040 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.332188 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.332316 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.332497 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.332637 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.332810 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.332936 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.333127 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.333255 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.333471 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.333613 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.333790 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.333919 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.334119 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.334255 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.334423 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.334552 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.334729 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.334856 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.335039 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.335174 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.335345 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.335558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.335686 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.335879 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.336007 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.336743 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.336928 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.337092 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.337219 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.337416 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.337547 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.337722 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.337862 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.338047 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.338175 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.338351 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.338479 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.338726 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.338881 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.339008 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.339140 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.339265 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.339390 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.339549 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.339677 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.339851 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.339979 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.340173 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.340299 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.340484 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.340619 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.340787 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.340914 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.341107 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.341234 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.341444 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.341582 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.341772 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.341975 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.342104 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.342324 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.342463 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.342642 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.342769 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.342971 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.343111 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.343298 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.343427 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.343609 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.343735 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.343916 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.344044 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.344228 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.344356 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.344536 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.344663 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.344843 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.344970 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.345159 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.345285 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.345499 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.345626 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.345806 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.346003 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.346131 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.346331 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.346466 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.346659 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.346795 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.346975 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.347104 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.347289 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.347417 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.347591 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.347717 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.347901 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.348028 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.348214 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.348348 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.348518 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.348644 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.348848 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.348985 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.349111 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.349235 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.349440 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.349582 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.349747 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.349882 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.350057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.350185 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.350362 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.350498 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.350675 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.350810 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.350981 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.351109 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.351292 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.351430 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.351598 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.351726 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.352470 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.352612 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.352774 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.352956 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.353089 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.353211 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.353457 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.353598 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.353775 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.353903 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.354096 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.354234 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.354414 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.354548 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.354728 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.354856 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.355038 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.355163 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.355349 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.355483 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.355664 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.355789 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.355974 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.356100 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.356285 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.356420 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.356598 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.356733 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.356913 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.357141 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.357276 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.357506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.357641 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.357834 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.357968 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.358171 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.358309 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.358501 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.358626 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.358807 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.358931 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.359116 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.359328 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.359464 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.359648 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.359775 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.359985 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.360111 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.360315 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.360444 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.360632 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.360759 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.360946 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.361072 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.361258 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.361411 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.361595 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.361725 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.361904 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.362044 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.362211 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.362339 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.362521 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.362649 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.362830 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.362965 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.363133 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.363258 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.363440 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.363568 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.363752 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.363889 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.364052 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.364185 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.364366 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.364492 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.364673 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.364801 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.365021 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.365203 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.365362 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.365578 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.365717 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.365895 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.366023 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.366224 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.366350 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.366551 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.366687 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.366866 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.366991 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.367171 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.367308 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.367509 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.367659 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.367847 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.367978 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.368206 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.368333 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.368522 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.368651 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.368833 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.368961 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.369140 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.369268 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.369469 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.369598 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.369780 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.369909 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.370090 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.370217 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.370394 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.370522 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.370704 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.370831 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.371007 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.371145 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.371332 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.371459 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.371638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.371765 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.371942 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.372079 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.372246 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.372373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.372556 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.372684 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.372861 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.372999 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.373164 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.373342 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.373495 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.373622 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.373799 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.373940 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.374110 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.374238 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.374413 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.374547 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.374724 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.374861 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.375029 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.375158 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.375339 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.375467 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.375673 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.375802 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.375948 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.376081 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.376253 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.376388 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.376560 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.376689 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.376866 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.376997 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.377176 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.377326 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.377508 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.377651 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.377817 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.377951 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.378119 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.378256 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.378424 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.378551 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.378729 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.378856 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.379034 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.379170 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.379343 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.379477 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.379644 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.379897 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.380025 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.380235 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.380365 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.380537 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.380663 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.380888 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.381031 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.381166 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.381339 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.381514 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.381641 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.381823 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.381963 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.382129 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.382257 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.382442 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.382568 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.382751 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.382887 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.383095 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.383226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.383466 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.383594 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.383783 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.383919 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.384097 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.384226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.384408 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.384537 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.384720 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.384857 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.385030 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.385165 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.385361 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.385491 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.385678 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.385815 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.385991 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.386118 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.386299 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.386433 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.386608 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.386812 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.386941 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.387065 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.387218 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.387347 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.387542 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.387670 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.387864 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.388000 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.388182 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.388325 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.388495 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.388623 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.388810 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.388948 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.389118 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.389253 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.389450 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.389578 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.389759 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.389898 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.390069 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.390207 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.390378 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.390512 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.390692 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.390821 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.391005 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.391134 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.391311 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.391440 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.391619 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.391746 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.391932 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.392061 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.392252 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.392389 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.392568 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.392695 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.392896 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.393038 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.393227 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.393373 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.393567 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.393707 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.393875 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.394004 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.394195 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.394323 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.394507 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.394648 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.394835 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.394963 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.395171 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.395292 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.395502 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.395638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.395821 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.395955 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.396123 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.396257 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.396428 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.396565 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.396690 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 06:28:10.396813 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.397028 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.397372 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.397684 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.397988 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.398289 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.398597 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.399488 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.399793 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.400098 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.400404 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.400712 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.401017 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.401353 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.401660 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.401963 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.402267 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.402569 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.402876 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.403178 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.403482 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.403782 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.404085 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.404386 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.404719 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.405050 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.405393 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.405720 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.406029 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.406353 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.406663 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.406986 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.407308 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.407623 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.407930 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.408260 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.408568 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.408878 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.409185 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.409517 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.409826 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.410137 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.410464 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.410791 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.411100 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.411426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.411745 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.412064 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.412381 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.412691 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.413021 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.413354 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.413666 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.413976 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.414299 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.415180 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.415502 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.415814 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.416126 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.416441 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.416757 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.417086 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.417443 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.417756 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.418084 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.418412 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.418800 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.419073 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.419416 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.419747 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.420060 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.420372 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.420677 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:28:10.420920 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 06:28:10.550409 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO dbcounter [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Registered counter for database nova_api Jul 28 06:28:10.573476 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG oslo_db.sqlalchemy.engines [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103528) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:28:10.575284 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO dbcounter [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Registered counter for database nova_api Jul 28 06:28:10.580058 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writer thread running {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:28:10.604424 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_db.sqlalchemy.engines [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:28:10.611354 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writer thread running {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:28:10.642999 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.context [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a6e3eabf-f037-414e-9584-b60d50f4a3c2(cell1) {{(pid=103528) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 06:28:10.646950 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG oslo_concurrency.lockutils [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:10.648510 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG oslo_concurrency.lockutils [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:10.649467 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG oslo_concurrency.lockutils [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:10.651435 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG oslo_concurrency.lockutils [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:10.653430 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO dbcounter [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Registered counter for database nova_cell0 Jul 28 06:28:10.658962 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO dbcounter [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Registered counter for database nova_cell1 Jul 28 06:28:10.666793 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG oslo_db.sqlalchemy.engines [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103528) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:28:10.668990 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.context [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a6e3eabf-f037-414e-9584-b60d50f4a3c2(cell1) {{(pid=103527) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 06:28:10.669874 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG oslo_db.sqlalchemy.engines [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103528) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:28:10.673035 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:10.673204 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writer thread running {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:28:10.674697 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:10.675489 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:10.677577 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:10.679486 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO dbcounter [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Registered counter for database nova_cell0 Jul 28 06:28:10.685672 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO dbcounter [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Registered counter for database nova_cell1 Jul 28 06:28:10.692637 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_db.sqlalchemy.engines [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:28:10.696110 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_db.sqlalchemy.engines [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:28:10.698601 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writer thread running {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:28:10.810618 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writer thread running {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:28:10.821217 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO dbcounter [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Registered counter for database nova_cell0 Jul 28 06:28:10.830300 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG oslo_db.sqlalchemy.engines [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103528) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:28:10.834940 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writer thread running {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:28:10.839807 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writer thread running {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:28:10.848376 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO dbcounter [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Registered counter for database nova_cell0 Jul 28 06:28:10.855672 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_db.sqlalchemy.engines [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:28:10.860872 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writer thread running {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:28:11.185834 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: WARNING keystonemiddleware.auth_token [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:28:11.193238 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: WARNING keystonemiddleware.auth_token [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:28:11.206329 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: WARNING keystonemiddleware.auth_token [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:28:11.213835 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: WARNING keystonemiddleware.auth_token [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:28:11.538519 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: WARNING keystonemiddleware.auth_token [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:28:11.545180 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: WARNING keystonemiddleware.auth_token [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:28:11.550583 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bde0879c0 pid: 103527 (default app) Jul 28 06:28:11.552757 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:11.553979 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001852 Jul 28 06:28:11.554408 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Thu Jul 28 06:28:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:28:11.591094 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: WARNING keystonemiddleware.auth_token [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:28:11.597077 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: WARNING keystonemiddleware.auth_token [None req-416192b8-5419-4042-b6f9-fc51d9fbce49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:28:11.602497 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bde0879c0 pid: 103528 (default app) Jul 28 06:29:27.953053 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:27.954052 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 28 06:29:27.954455 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:27.967074 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writing DB stats nova_api:SELECT=3 {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:27.968448 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writing DB stats nova_cell1:SELECT=3 {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:27.969517 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writing DB stats nova_cell0:SELECT=3 {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:27.970299 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:28.853774 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-482d48e8-89ee-4cdf-8c78-1e2e105e53cc admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:28.887286 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-482d48e8-89ee-4cdf-8c78-1e2e105e53cc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925204 Jul 28 06:29:28.888269 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jul 28 06:29:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:31.267973 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:31.268977 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-5a195914-b9e7-4447-81ff-24f346202cb5 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 28 06:29:31.269651 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:31.753897 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-1a96ab86-2655-43f6-831d-c1ccd7eda494 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "swap": 0, "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:31.774286 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:31.774286 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: warnings.warn(msg) Jul 28 06:29:31.803861 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-1a96ab86-2655-43f6-831d-c1ccd7eda494 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.526997 Jul 28 06:29:31.805187 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 28 06:29:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:29:31.819245 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_api:SELECT=3 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:31.820411 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_cell0:SELECT=3 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:31.821663 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_cell1:SELECT=3 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:31.822475 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_cell0:SELECT=3 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:32.052725 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-8fa4306e-5efe-4f9f-a37f-adff72706e15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:32.057059 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:32.057059 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: warnings.warn(msg) Jul 28 06:29:32.125651 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-8fa4306e-5efe-4f9f-a37f-adff72706e15 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.312637 Jul 28 06:29:32.126266 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jul 28 06:29:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:34.386203 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-1a96ab86-2655-43f6-831d-c1ccd7eda494 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:34.387977 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-1a96ab86-2655-43f6-831d-c1ccd7eda494 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002302 Jul 28 06:29:34.388466 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:35.042213 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-a7d059cb-b0f4-4aec-82a7-5188da7be022 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:35.061797 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:35.061797 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: warnings.warn(msg) Jul 28 06:29:35.085306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-a7d059cb-b0f4-4aec-82a7-5188da7be022 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.690625 Jul 28 06:29:35.085990 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 28 06:29:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:29:35.098785 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-4612bf6d-a0c8-4f0c-b9b5-3257f5507d5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:35.102135 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:29:35.102135 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: warnings.warn(msg) Jul 28 06:29:35.138667 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-4612bf6d-a0c8-4f0c-b9b5-3257f5507d5f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044067 Jul 28 06:29:35.139421 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jul 28 06:29:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:37.385435 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-a7d059cb-b0f4-4aec-82a7-5188da7be022 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:37.386455 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-a7d059cb-b0f4-4aec-82a7-5188da7be022 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 28 06:29:37.386857 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:37.829082 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-8e17e543-4946-41fa-9d3c-fb3d376e3599 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0}} {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:37.848442 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-8e17e543-4946-41fa-9d3c-fb3d376e3599 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455673 Jul 28 06:29:37.849457 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 28 06:29:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:29:37.861497 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-64559479-6d99-41fc-b0dc-c3f56814f26d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:37.886028 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-64559479-6d99-41fc-b0dc-c3f56814f26d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028270 Jul 28 06:29:37.886595 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jul 28 06:29:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:40.102514 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-8e17e543-4946-41fa-9d3c-fb3d376e3599 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:40.103902 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-8e17e543-4946-41fa-9d3c-fb3d376e3599 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001880 Jul 28 06:29:40.104845 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:40.543728 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-8eb42e9c-46e0-4e50-9b8b-0ab0d6de25f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:40.577521 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-8eb42e9c-46e0-4e50-9b8b-0ab0d6de25f2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.463959 Jul 28 06:29:40.577521 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 28 06:29:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:29:40.588152 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-cf322061-eea6-4347-86c3-273b73ecbee8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:40.624833 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-cf322061-eea6-4347-86c3-273b73ecbee8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041036 Jul 28 06:29:40.626313 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jul 28 06:29:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:42.863604 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-8eb42e9c-46e0-4e50-9b8b-0ab0d6de25f2 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:42.864653 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-8eb42e9c-46e0-4e50-9b8b-0ab0d6de25f2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 28 06:29:42.865164 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:43.288309 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-d1eae304-2720-48b6-8fd8-470de355875f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:43.308710 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-d1eae304-2720-48b6-8fd8-470de355875f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437417 Jul 28 06:29:43.311340 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 28 06:29:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:29:43.321971 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-f02c3031-4cb5-4bc5-9708-ceda5cc51c86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:43.347143 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-f02c3031-4cb5-4bc5-9708-ceda5cc51c86 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029466 Jul 28 06:29:43.348017 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jul 28 06:29:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:45.770221 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-d1eae304-2720-48b6-8fd8-470de355875f admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:45.772274 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-d1eae304-2720-48b6-8fd8-470de355875f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002621 Jul 28 06:29:45.772815 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:46.241023 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-e2ee5da8-62b3-4a48-9829-056dae16ce04 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:46.266300 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-e2ee5da8-62b3-4a48-9829-056dae16ce04 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.487081 Jul 28 06:29:46.266883 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jul 28 06:29:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:29:48.629556 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-d1eae304-2720-48b6-8fd8-470de355875f admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:48.631138 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-d1eae304-2720-48b6-8fd8-470de355875f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002202 Jul 28 06:29:48.631637 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:49.106763 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-d0466597-ab0d-4976-a8de-884cc02cd222 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "ram": 512}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:49.127271 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-d0466597-ab0d-4976-a8de-884cc02cd222 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.486557 Jul 28 06:29:49.127850 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 28 06:29:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:29:49.140800 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-d2c5f671-4e27-4989-bb40-29a4023f1e96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:49.167716 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-d2c5f671-4e27-4989-bb40-29a4023f1e96 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030573 Jul 28 06:29:49.168499 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jul 28 06:29:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:51.482632 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-d0466597-ab0d-4976-a8de-884cc02cd222 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:51.483651 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-d0466597-ab0d-4976-a8de-884cc02cd222 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 28 06:29:51.484053 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:51.902164 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-5bfa9e96-549d-4240-a634-2ad568762916 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "ram": 2048, "vcpus": 1, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:51.920567 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-5bfa9e96-549d-4240-a634-2ad568762916 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.430152 Jul 28 06:29:51.921127 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 28 06:29:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:29:51.933142 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-7eba3c78-de65-43d8-b11d-a75c3be15566 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:51.958350 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-7eba3c78-de65-43d8-b11d-a75c3be15566 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028166 Jul 28 06:29:51.959398 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jul 28 06:29:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:54.208635 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-5bfa9e96-549d-4240-a634-2ad568762916 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:54.209826 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-5bfa9e96-549d-4240-a634-2ad568762916 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002218 Jul 28 06:29:54.210236 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:54.606851 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-66d3718a-27b6-4264-a60d-24aefdc97ed4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:54.627973 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-66d3718a-27b6-4264-a60d-24aefdc97ed4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.411674 Jul 28 06:29:54.628521 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 28 06:29:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:29:54.641794 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-443a56c1-97e6-49af-8ac0-2fb8849052da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:54.667678 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-443a56c1-97e6-49af-8ac0-2fb8849052da admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029728 Jul 28 06:29:54.668626 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jul 28 06:29:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:56.949729 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-66d3718a-27b6-4264-a60d-24aefdc97ed4 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:56.950778 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-66d3718a-27b6-4264-a60d-24aefdc97ed4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 28 06:29:56.953648 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:56 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:57.401272 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-0b6ae2f0-cf5a-4c0c-a57a-ac49c63f7522 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:57.421178 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-0b6ae2f0-cf5a-4c0c-a57a-ac49c63f7522 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.464141 Jul 28 06:29:57.421980 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 28 06:29:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:29:57.434112 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-984b71f5-3c5f-47be-8f4f-966a547de73d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:57.463813 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-984b71f5-3c5f-47be-8f4f-966a547de73d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033326 Jul 28 06:29:57.464478 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jul 28 06:29:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:59.710430 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-0b6ae2f0-cf5a-4c0c-a57a-ac49c63f7522 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:59.711467 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-0b6ae2f0-cf5a-4c0c-a57a-ac49c63f7522 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 28 06:29:59.711947 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:29:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:00.272969 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-c31f7a03-b4fe-4633-8c99-8538fca1f936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:00.292646 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-c31f7a03-b4fe-4633-8c99-8538fca1f936 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.573851 Jul 28 06:30:00.293804 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 28 06:29:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:30:00.307349 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-a28dd003-d68f-4cac-9e38-979e5be81de5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:00.312136 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:00.340082 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-a28dd003-d68f-4cac-9e38-979e5be81de5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036400 Jul 28 06:30:00.340669 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jul 28 06:30:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:20.127085 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-c31f7a03-b4fe-4633-8c99-8538fca1f936 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:20.128132 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-c31f7a03-b4fe-4633-8c99-8538fca1f936 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 28 06:30:20.128560 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:30:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:20.139229 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:20.526341 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-821208c4-7cd1-480d-9106-d291f47ebb0d admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:20.544226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-821208c4-7cd1-480d-9106-d291f47ebb0d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409584 Jul 28 06:30:20.544699 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jul 28 06:30:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:21.626214 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-c31f7a03-b4fe-4633-8c99-8538fca1f936 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:21.627238 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-c31f7a03-b4fe-4633-8c99-8538fca1f936 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 28 06:30:21.627641 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:30:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:22.166943 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-ba534af9-dba5-4570-a9eb-3e72d850a119 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:22.173314 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.wsgi [None req-ba534af9-dba5-4570-a9eb-3e72d850a119 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-ba534af9-dba5-4570-a9eb-3e72d850a119 admin admin] Request method failure captured: Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Accept: application/json Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Accept-Encoding: gzip, deflate Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Connection: keep-alive Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Content-Length: 0 Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Host: 10.222.0.20 Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Openstack-Api-Version: compute 2.90 Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Openstack-System-Scope: None Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: User-Agent: python-novaclient Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Auth-Token: gAAAAABi4iz9Gl7-CrHx8_mN52aVW3VuQ6a73KWCngobzuK3DwIfflEjBWgpKWErBEGHTO8IhcAZVIJoVqp1Rf6qw_i7x6Q1d6zr-f9tg2e6i_YL509wKsKTpvO2UjtyzxGshiX5gotdRQDWF6ju5faqJjAgW7mLBdharRjcWTsMnGaY_VXhC9k Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Domain-Id: None Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Domain-Name: None Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Identity-Status: Confirmed Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Is-Admin-Project: True Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Domain-Id: default Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Domain-Name: Default Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Name: admin Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Role: admin,member,reader Jul 28 06:30:22.176506 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Roles: admin,member,reader Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25016d71f554431cbc0d0222ca313083", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25016d71f554431cbc0d0222ca313083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}] Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Tenant: admin Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Tenant-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Tenant-Name: admin Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User: admin Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Domain-Id: default Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Domain-Name: Default Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Id: 5666224e1bf547bc87b970165a115158 Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Name: admin Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: method: > Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: exception: Flavor 42 could not be found. Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: action_args: {'id': '42'} Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:30:22.178235 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:22.179373 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 06:30:22.180788 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:22.182589 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-ba534af9-dba5-4570-a9eb-3e72d850a119 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:30:22.183402 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-ba534af9-dba5-4570-a9eb-3e72d850a119 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.416266 Jul 28 06:30:22.183918 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jul 28 06:30:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 06:30:22.194183 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-adba4f11-3766-406a-90ea-f75b36509d66 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:22.198729 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:22.218509 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-adba4f11-3766-406a-90ea-f75b36509d66 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028955 Jul 28 06:30:22.219082 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 28 06:30:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:22.229438 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-98644f71-9b44-4e45-8db7-efab3f994e2a admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:22.254146 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-98644f71-9b44-4e45-8db7-efab3f994e2a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027924 Jul 28 06:30:22.255058 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 28 06:30:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:22.266319 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-0f39edbf-1be5-4b3a-a097-51ffb4d7fff1 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:22.272764 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.wsgi [None req-0f39edbf-1be5-4b3a-a097-51ffb4d7fff1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-0f39edbf-1be5-4b3a-a097-51ffb4d7fff1 admin admin] Request method failure captured: Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Accept: application/json Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Accept-Encoding: gzip, deflate Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Connection: keep-alive Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Content-Length: 0 Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Host: 10.222.0.20 Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Openstack-Api-Version: compute 2.90 Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Openstack-System-Scope: None Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: User-Agent: python-novaclient Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Auth-Token: gAAAAABi4iz9Gl7-CrHx8_mN52aVW3VuQ6a73KWCngobzuK3DwIfflEjBWgpKWErBEGHTO8IhcAZVIJoVqp1Rf6qw_i7x6Q1d6zr-f9tg2e6i_YL509wKsKTpvO2UjtyzxGshiX5gotdRQDWF6ju5faqJjAgW7mLBdharRjcWTsMnGaY_VXhC9k Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Domain-Id: None Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Domain-Name: None Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Identity-Status: Confirmed Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Is-Admin-Project: True Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Domain-Id: default Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Domain-Name: Default Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Name: admin Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Role: admin,member,reader Jul 28 06:30:22.276037 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Roles: admin,member,reader Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25016d71f554431cbc0d0222ca313083", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25016d71f554431cbc0d0222ca313083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}] Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Tenant: admin Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Tenant-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Tenant-Name: admin Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User: admin Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Domain-Id: default Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Domain-Name: Default Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Id: 5666224e1bf547bc87b970165a115158 Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Name: admin Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: method: > Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: exception: Flavor 42 could not be found. Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: action_args: {'id': '42'} Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:30:22.277621 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:22.278638 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:22.279749 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-0f39edbf-1be5-4b3a-a097-51ffb4d7fff1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:30:22.280901 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-0f39edbf-1be5-4b3a-a097-51ffb4d7fff1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016341 Jul 28 06:30:22.280901 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jul 28 06:30:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 06:30:23.272873 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-98644f71-9b44-4e45-8db7-efab3f994e2a admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:23.273898 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-98644f71-9b44-4e45-8db7-efab3f994e2a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 28 06:30:23.274291 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:30:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:23.806892 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-9718d5d4-0a62-478f-bc9d-7ed890cc7fdc admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:23.812131 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.wsgi [None req-9718d5d4-0a62-478f-bc9d-7ed890cc7fdc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-9718d5d4-0a62-478f-bc9d-7ed890cc7fdc admin admin] Request method failure captured: Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Accept: application/json Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Accept-Encoding: gzip, deflate Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Connection: keep-alive Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Content-Length: 0 Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Host: 10.222.0.20 Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Openstack-Api-Version: compute 2.90 Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Openstack-System-Scope: None Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: User-Agent: python-novaclient Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Auth-Token: gAAAAABi4iz_dvUm-MV1-EEpIs8YxrJh0SVhYxK1EJNo-0prPN2rK9i-kd1sighY3rlRBZUxxrDl-1vOZHLKPKBZEU82zJ0O5dX5_kTBB01kQd2K0qsd9lUXG2Aj-h2OF20Rx_LMMK7rMGv4o4r-pEeqPZkr1AJNZA2GJ92Hv9Mnd-RhUlZkkxU Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Domain-Id: None Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Domain-Name: None Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Identity-Status: Confirmed Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Is-Admin-Project: True Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Domain-Id: default Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Domain-Name: Default Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Name: admin Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Role: admin,member,reader Jul 28 06:30:23.813655 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Roles: admin,member,reader Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25016d71f554431cbc0d0222ca313083", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25016d71f554431cbc0d0222ca313083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}] Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Tenant: admin Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Tenant-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Tenant-Name: admin Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User: admin Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Domain-Id: default Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Domain-Name: Default Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Id: 5666224e1bf547bc87b970165a115158 Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Name: admin Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: method: > Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: exception: Flavor 84 could not be found. Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: action_args: {'id': '84'} Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:30:23.815230 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:23.816886 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:23.818306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-9718d5d4-0a62-478f-bc9d-7ed890cc7fdc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:30:23.819541 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-9718d5d4-0a62-478f-bc9d-7ed890cc7fdc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398610 Jul 28 06:30:23.819541 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jul 28 06:30:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 06:30:23.824891 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-b5ca7024-8aef-49d4-ab9d-8645324c8863 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:23.841684 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-b5ca7024-8aef-49d4-ab9d-8645324c8863 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020258 Jul 28 06:30:23.842229 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 28 06:30:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:23.852477 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-d9297efd-1653-409b-9902-430e2c9f62dd admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:23.869527 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-d9297efd-1653-409b-9902-430e2c9f62dd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020483 Jul 28 06:30:23.870075 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 28 06:30:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:23.879400 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-758c78a1-6377-4c02-a298-59f57c70fd97 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:23.884708 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.wsgi [None req-758c78a1-6377-4c02-a298-59f57c70fd97 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-758c78a1-6377-4c02-a298-59f57c70fd97 admin admin] Request method failure captured: Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Accept: application/json Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Accept-Encoding: gzip, deflate Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Connection: keep-alive Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Content-Length: 0 Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Host: 10.222.0.20 Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Openstack-Api-Version: compute 2.90 Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Openstack-System-Scope: None Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: User-Agent: python-novaclient Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Auth-Token: gAAAAABi4iz_dvUm-MV1-EEpIs8YxrJh0SVhYxK1EJNo-0prPN2rK9i-kd1sighY3rlRBZUxxrDl-1vOZHLKPKBZEU82zJ0O5dX5_kTBB01kQd2K0qsd9lUXG2Aj-h2OF20Rx_LMMK7rMGv4o4r-pEeqPZkr1AJNZA2GJ92Hv9Mnd-RhUlZkkxU Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Domain-Id: None Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Domain-Name: None Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Identity-Status: Confirmed Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Is-Admin-Project: True Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Domain-Id: default Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Domain-Name: Default Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Name: admin Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Role: admin,member,reader Jul 28 06:30:23.886226 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Roles: admin,member,reader Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25016d71f554431cbc0d0222ca313083", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25016d71f554431cbc0d0222ca313083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}] Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Tenant: admin Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Tenant-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Tenant-Name: admin Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User: admin Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Domain-Id: default Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Domain-Name: Default Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Id: 5666224e1bf547bc87b970165a115158 Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Name: admin Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: method: > Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: exception: Flavor 84 could not be found. Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: action_args: {'id': '84'} Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:30:23.887587 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:23.888494 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:23.890057 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-758c78a1-6377-4c02-a298-59f57c70fd97 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:30:23.891292 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-758c78a1-6377-4c02-a298-59f57c70fd97 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011737 Jul 28 06:30:23.891292 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jul 28 06:30:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 06:30:24.855140 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-d9297efd-1653-409b-9902-430e2c9f62dd admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:24.856145 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-d9297efd-1653-409b-9902-430e2c9f62dd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 28 06:30:24.856544 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:25.381267 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-fccde5ab-3716-4c5e-a35e-c1efec6b4748 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:25.386967 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.wsgi [None req-fccde5ab-3716-4c5e-a35e-c1efec6b4748 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-fccde5ab-3716-4c5e-a35e-c1efec6b4748 admin admin] Request method failure captured: Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Accept: application/json Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Accept-Encoding: gzip, deflate Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Connection: keep-alive Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Content-Length: 0 Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Host: 10.222.0.20 Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Openstack-Api-Version: compute 2.90 Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Openstack-System-Scope: None Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: User-Agent: python-novaclient Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Auth-Token: gAAAAABi4i0AwnmtkKhx0dnRn3Ju6cPiAw4DPJNbtCLYIwl1raqxJT4y_apFnlpkdrPC8reK6-bcMK3jyMAFwiHCv9kuPEnT3QXRed9oqUz2mjbahcjiDW8LTvhOY7a0yigRPe47OMYPaaVdeWkGzf79zOfCioEty7qdoo71bMGfzhvHgVHlU3I Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Domain-Id: None Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Domain-Name: None Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Identity-Status: Confirmed Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Is-Admin-Project: True Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Domain-Id: default Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Domain-Name: Default Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Project-Name: admin Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Role: admin,member,reader Jul 28 06:30:25.388451 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Roles: admin,member,reader Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25016d71f554431cbc0d0222ca313083", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25016d71f554431cbc0d0222ca313083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}] Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Tenant: admin Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Tenant-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-Tenant-Name: admin Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User: admin Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Domain-Id: default Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Domain-Name: Default Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Id: 5666224e1bf547bc87b970165a115158 Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: X-User-Name: admin Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: method: > Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: exception: Flavor 451 could not be found. Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: action_args: {'id': '451'} Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:30:25.390154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:25.391381 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.392558 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-fccde5ab-3716-4c5e-a35e-c1efec6b4748 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:30:25.393674 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-fccde5ab-3716-4c5e-a35e-c1efec6b4748 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393435 Jul 28 06:30:25.393674 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 28 06:30:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 06:30:25.399570 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-fd8a7bc4-a7a2-4ac3-b447-4f095c2ee295 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:25.415131 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-fd8a7bc4-a7a2-4ac3-b447-4f095c2ee295 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019142 Jul 28 06:30:25.415656 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 28 06:30:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:25.424785 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:25.440795 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019463 Jul 28 06:30:25.441948 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 28 06:30:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:30:25.451467 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-e4fb337a-3aef-4c24-8df1-6c17b738ebcd admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:25.457919 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.wsgi [None req-e4fb337a-3aef-4c24-8df1-6c17b738ebcd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-e4fb337a-3aef-4c24-8df1-6c17b738ebcd admin admin] Request method failure captured: Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Accept: application/json Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Accept-Encoding: gzip, deflate Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Connection: keep-alive Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Content-Length: 0 Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Host: 10.222.0.20 Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Openstack-Api-Version: compute 2.90 Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Openstack-System-Scope: None Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: User-Agent: python-novaclient Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Auth-Token: gAAAAABi4i0AwnmtkKhx0dnRn3Ju6cPiAw4DPJNbtCLYIwl1raqxJT4y_apFnlpkdrPC8reK6-bcMK3jyMAFwiHCv9kuPEnT3QXRed9oqUz2mjbahcjiDW8LTvhOY7a0yigRPe47OMYPaaVdeWkGzf79zOfCioEty7qdoo71bMGfzhvHgVHlU3I Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Domain-Id: None Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Domain-Name: None Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Identity-Status: Confirmed Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Is-Admin-Project: True Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Domain-Id: default Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Domain-Name: Default Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Project-Name: admin Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Role: admin,member,reader Jul 28 06:30:25.459426 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Roles: admin,member,reader Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25016d71f554431cbc0d0222ca313083", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25016d71f554431cbc0d0222ca313083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25016d71f554431cbc0d0222ca313083"}]}] Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Tenant: admin Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Tenant-Id: 25016d71f554431cbc0d0222ca313083 Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-Tenant-Name: admin Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User: admin Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Domain-Id: default Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Domain-Name: Default Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Id: 5666224e1bf547bc87b970165a115158 Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: X-User-Name: admin Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: method: > Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: exception: Flavor 451 could not be found. Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: action_args: {'id': '451'} Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:30:25.461010 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:25.462699 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.464401 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-e4fb337a-3aef-4c24-8df1-6c17b738ebcd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:30:25.465697 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-e4fb337a-3aef-4c24-8df1-6c17b738ebcd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012922 Jul 28 06:30:25.465697 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 28 06:30:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 06:30:26.427447 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:26.428465 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 28 06:30:26.428858 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:30:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:26.961034 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-c1ed9d64-3679-4e6f-82f3-efd1978d4062 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:26.980340 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-c1ed9d64-3679-4e6f-82f3-efd1978d4062 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.412087 Jul 28 06:30:26.980880 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jul 28 06:30:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:30:28.023636 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:28.024657 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 28 06:30:28.025047 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:30:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:28.594108 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-40152b44-0b8f-4f68-b464-a31fa430d123 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:28.613836 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-40152b44-0b8f-4f68-b464-a31fa430d123 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.432349 Jul 28 06:30:28.614376 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jul 28 06:30:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:30:29.598755 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:29.599767 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002238 Jul 28 06:30:29.600182 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:30.150420 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-27d1b0d9-50b6-4eeb-8aaa-bc5094983a38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:30.169229 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-27d1b0d9-50b6-4eeb-8aaa-bc5094983a38 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.428626 Jul 28 06:30:30.169791 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jul 28 06:30:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:30:31.156154 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:31.157202 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 28 06:30:31.157637 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:30:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:31.686203 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-8bf7c597-c6fd-4df2-9c8b-8ea8ab8d6478 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:31.705445 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-8bf7c597-c6fd-4df2-9c8b-8ea8ab8d6478 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.408014 Jul 28 06:30:31.705974 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jul 28 06:30:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:30:32.681119 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:32.682167 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 28 06:30:32.682727 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:30:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:33.208202 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-94b693a9-ef05-40bc-b32e-670ecdb7a002 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:33.228977 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-94b693a9-ef05-40bc-b32e-670ecdb7a002 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406260 Jul 28 06:30:33.229477 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Thu Jul 28 06:30:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:25.078924 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:25.079944 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-75714578-61ce-4e7a-b2bb-a9e95021d4c7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 28 06:31:25.081085 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 28 06:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:25.091510 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:25.473027 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-096e37ad-2fdc-45a6-b7cb-f108bd5fb97c admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:25.493629 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-096e37ad-2fdc-45a6-b7cb-f108bd5fb97c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406466 Jul 28 06:31:25.494093 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jul 28 06:31:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:25.515355 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG dbcounter [-] [103528] Writing DB stats nova_api:SELECT=14 {{(pid=103528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:25.519915 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-1fb7671b-82ce-4017-9229-c33c24f06415 admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:25.527617 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-1fb7671b-82ce-4017-9229-c33c24f06415 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013643 Jul 28 06:31:25.528142 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Thu Jul 28 06:31:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:25.539790 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-40af46c1-b597-4693-9aa9-f6837e8e66b2 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:25.547614 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-40af46c1-b597-4693-9aa9-f6837e8e66b2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011449 Jul 28 06:31:25.548124 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Thu Jul 28 06:31:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:25.559402 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:25.567389 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011551 Jul 28 06:31:25.567907 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Thu Jul 28 06:31:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:25.579149 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-531e1bce-5880-4c8d-9720-feb09e44e95c admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:25.587302 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-531e1bce-5880-4c8d-9720-feb09e44e95c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011665 Jul 28 06:31:25.587805 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Thu Jul 28 06:31:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:34:51.627295 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:51.628975 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Jul 28 06:34:51.629400 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:34:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:51.772087 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_api:SELECT=6 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:51.931461 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-7bd20cca-0696-4f39-a886-b55b81559544 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:51.934004 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:34:51.934004 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: warnings.warn(msg) Jul 28 06:34:51.935263 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-7bd20cca-0696-4f39-a886-b55b81559544 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:51.935711 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-7bd20cca-0696-4f39-a886-b55b81559544 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:51.936518 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-7bd20cca-0696-4f39-a886-b55b81559544 admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:51.936968 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-7bd20cca-0696-4f39-a886-b55b81559544 admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:51.971061 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-7bd20cca-0696-4f39-a886-b55b81559544 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200336 Jul 28 06:34:51.971608 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 28 06:34:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:34:52.808089 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:52.809106 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 28 06:34:52.809532 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:34:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:53.001792 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-cb000af8-0a0b-4edd-8060-e1a5ac93efd9 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:53.004668 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:34:53.004668 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: warnings.warn(msg) Jul 28 06:34:53.005974 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-cb000af8-0a0b-4edd-8060-e1a5ac93efd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:53.006508 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-cb000af8-0a0b-4edd-8060-e1a5ac93efd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:53.007211 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-cb000af8-0a0b-4edd-8060-e1a5ac93efd9 admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:53.007639 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-cb000af8-0a0b-4edd-8060-e1a5ac93efd9 admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:53.027841 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-cb000af8-0a0b-4edd-8060-e1a5ac93efd9 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078304 Jul 28 06:34:53.028306 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 28 06:34:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:35:04.281157 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:04.282221 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Jul 28 06:35:04.282624 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:35:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:04.425136 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_cell0:SELECT=4 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:04.425875 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_cell1:SELECT=4 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:04.426475 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_api:SELECT=8 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:04.476829 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-6eb57c85-0d67-41be-8522-7ec1fd9a31f8 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:04.479214 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:35:04.479214 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: warnings.warn(msg) Jul 28 06:35:04.480415 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-6eb57c85-0d67-41be-8522-7ec1fd9a31f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:04.480852 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-6eb57c85-0d67-41be-8522-7ec1fd9a31f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:04.481663 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-6eb57c85-0d67-41be-8522-7ec1fd9a31f8 admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:04.482089 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-6eb57c85-0d67-41be-8522-7ec1fd9a31f8 admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:04.501590 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-6eb57c85-0d67-41be-8522-7ec1fd9a31f8 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080724 Jul 28 06:35:04.502067 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 28 06:35:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:35:05.328116 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:05.329127 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 28 06:35:05.329636 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:35:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:05.523517 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-8c379529-46b1-4b8c-b368-3b8183351e08 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:05.525941 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:35:05.525941 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: warnings.warn(msg) Jul 28 06:35:05.527156 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-8c379529-46b1-4b8c-b368-3b8183351e08 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:05.527602 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-8c379529-46b1-4b8c-b368-3b8183351e08 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:05.528387 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-8c379529-46b1-4b8c-b368-3b8183351e08 admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:05.528818 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-8c379529-46b1-4b8c-b368-3b8183351e08 admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:05.553753 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-8c379529-46b1-4b8c-b368-3b8183351e08 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082938 Jul 28 06:35:05.554257 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 28 06:35:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:16.788663 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:16.789705 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 28 06:35:16.790112 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 38/77] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:35:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:16.934667 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_cell0:SELECT=4 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:16.935392 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_cell1:SELECT=4 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:16.936026 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG dbcounter [-] [103527] Writing DB stats nova_api:SELECT=8 {{(pid=103527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:16.985960 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-25403007-ce7d-451d-a7ee-d2b9dc0ec3b4 admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:16.988339 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:35:16.988339 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: warnings.warn(msg) Jul 28 06:35:16.989550 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-25403007-ce7d-451d-a7ee-d2b9dc0ec3b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:16.991125 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-25403007-ce7d-451d-a7ee-d2b9dc0ec3b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:16.991916 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-25403007-ce7d-451d-a7ee-d2b9dc0ec3b4 admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:16.992348 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-25403007-ce7d-451d-a7ee-d2b9dc0ec3b4 admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:17.014022 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-25403007-ce7d-451d-a7ee-d2b9dc0ec3b4 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083675 Jul 28 06:35:17.014506 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 40/78] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 28 06:35:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:17.847776 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: DEBUG nova.api.openstack.wsgi [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] Calling method '>' {{(pid=103528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:17.848804 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: INFO nova.api.openstack.requestlog [None req-748eac05-ec22-4716-bf9a-46097290f30a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jul 28 06:35:17.849317 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: [pid: 103528|app: 0|req: 39/79] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 28 06:35:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:18.039211 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG nova.api.openstack.wsgi [None req-efcebde6-c2e3-4c49-a94b-2993bfd69a8f admin admin] Calling method '>' {{(pid=103527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:18.041650 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:35:18.041650 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: warnings.warn(msg) Jul 28 06:35:18.042826 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-efcebde6-c2e3-4c49-a94b-2993bfd69a8f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:18.043269 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-efcebde6-c2e3-4c49-a94b-2993bfd69a8f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:18.044049 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-efcebde6-c2e3-4c49-a94b-2993bfd69a8f admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:18.044477 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: DEBUG oslo_concurrency.lockutils [None req-efcebde6-c2e3-4c49-a94b-2993bfd69a8f admin admin] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:18.067248 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: INFO nova.api.openstack.requestlog [None req-efcebde6-c2e3-4c49-a94b-2993bfd69a8f admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081215 Jul 28 06:35:18.067788 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: [pid: 103527|app: 0|req: 41/80] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 28 06:35:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:36:16.121059 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: Thu Jul 28 06:36:16 2022 - graceful shutdown triggered... Jul 28 06:36:16.121622 dv-cinder-850605-1-iscsi devstack@n-api.service[103528]: Gracefully killing worker 2 (pid: 103528)... Jul 28 06:36:16.122074 dv-cinder-850605-1-iscsi devstack@n-api.service[103527]: Gracefully killing worker 1 (pid: 103527)... Jul 28 06:36:16.123205 dv-cinder-850605-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 06:36:17.121655 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: worker 1 buried after 1 seconds Jul 28 06:36:17.122223 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: worker 2 buried after 1 seconds Jul 28 06:36:17.122223 dv-cinder-850605-1-iscsi devstack@n-api.service[103526]: goodbye to uWSGI. Jul 28 06:36:17.123235 dv-cinder-850605-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 06:36:17.123783 dv-cinder-850605-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 06:36:17.126570 dv-cinder-850605-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 06:36:17.136428 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 06:36:17.139084 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 06:36:17 2022] *** Jul 28 06:36:17.139251 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 06:36:17.139379 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 06:36:17.139495 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: nodename: dv-cinder-850605-1-iscsi Jul 28 06:36:17.139616 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: machine: x86_64 Jul 28 06:36:17.139753 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: clock source: unix Jul 28 06:36:17.139753 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: pcre jit disabled Jul 28 06:36:17.139753 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: detected number of CPU cores: 4 Jul 28 06:36:17.139753 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: current working directory: / Jul 28 06:36:17.139753 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: detected binary path: /usr/bin/uwsgi-core Jul 28 06:36:17.139753 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: your processes number limit is 47680 Jul 28 06:36:17.139753 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: your memory page size is 4096 bytes Jul 28 06:36:17.139753 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: detected max file descriptor number: 2048 Jul 28 06:36:17.139753 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: lock engine: pthread robust mutexes Jul 28 06:36:17.140344 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: thunder lock: enabled Jul 28 06:36:17.140344 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 06:36:17.140344 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 06:36:17.180364 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: Python main interpreter initialized at 0x55f7771bd9c0 Jul 28 06:36:17.180364 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: python threads support enabled Jul 28 06:36:17.180364 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: your server socket listen backlog is limited to 100 connections Jul 28 06:36:17.180364 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: your mercy for graceful operations on workers is 90 seconds Jul 28 06:36:17.180810 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 06:36:17.180810 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: *** Operational MODE: preforking *** Jul 28 06:36:17.181067 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: *** uWSGI is running in multiple interpreter mode *** Jul 28 06:36:17.181067 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: spawned uWSGI master process (pid: 124541) Jul 28 06:36:17.181276 dv-cinder-850605-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 06:36:17.181911 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: spawned uWSGI worker 1 (pid: 124562, cores: 1) Jul 28 06:36:17.182274 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: spawned uWSGI worker 2 (pid: 124563, cores: 1) Jul 28 06:36:17.184670 dv-cinder-850605-1-iscsi devstack@n-api.service[124541]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 06:36:17.855294 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 06:36:17.856109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 06:36:19.024075 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:36:19.024075 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: from cryptography.utils import int_from_bytes Jul 28 06:36:19.024776 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:36:19.024776 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: from cryptography.utils import int_from_bytes Jul 28 06:36:19.040500 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:36:19.040500 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: from cryptography.utils import int_from_bytes Jul 28 06:36:19.041079 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:36:19.041079 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: from cryptography.utils import int_from_bytes Jul 28 06:36:21.467884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 06:36:21.468459 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 06:36:21.468705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 06:36:21.469057 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 06:36:21.469330 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 06:36:21.469731 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.470065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.470391 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.470713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.471048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.471361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.471689 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.472033 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.472352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.472620 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.472939 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.473268 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850605-1-iscsi {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.473632 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.474125 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.474444 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.474773 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.475081 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.475415 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.476252 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.478163 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.478163 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.478163 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.478432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.478632 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.478952 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.479272 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.479601 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.479920 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.480248 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.480561 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.480981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850605-1-iscsi {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.481324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.481650 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.481971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.482411 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.482731 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.483038 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.483365 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.483707 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.484023 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.484359 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.484684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.485009 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.485361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.485670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.485982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.486296 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.486617 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.486930 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.487239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.487495 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.487807 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.488136 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.488461 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.488788 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.489048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.489353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.489677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.490004 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.490320 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.490633 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.490943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.491254 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.492194 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.492514 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.492825 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.493132 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.493491 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.493815 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.494147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.494459 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.494783 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.495204 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.495460 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.495769 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.496117 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.496439 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.496750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.497073 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.497436 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.497751 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.498063 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.498376 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.498699 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.499038 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.499346 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.499602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.499906 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.500215 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.500537 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.500850 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.501165 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.501499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.501805 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.502112 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.502422 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.502734 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.503042 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.503352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.503660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.503971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.504280 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.504587 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.504913 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.505246 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.505585 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.505899 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.506211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.506523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.506845 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.507196 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.507507 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.507836 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.508150 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.508461 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.508780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.509090 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.509429 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.509752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.510057 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.510372 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.510690 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.510997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.511308 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.511614 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.511921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.512228 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.512536 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.512841 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.513147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.513474 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.513799 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.514129 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.514448 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.514762 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.515074 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.515397 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.515744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.516080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.516430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.516748 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.517086 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.517445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.517768 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.518083 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.518400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.518785 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.519103 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.519420 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.519740 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.520063 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.520397 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.520716 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.521041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.521384 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.521712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.522029 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.522350 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.523378 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.523738 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.524055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.524406 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.524764 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.525096 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.525454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.525791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.526113 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.526433 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.526752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.527085 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.527426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.527745 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.528070 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.528388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.528707 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.529023 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.529363 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.529684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.530116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.530352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.530679 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.530998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.531954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.531954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.531954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.532417 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.532563 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.533102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.533102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.533469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.533744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.534091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.534469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.534745 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.535092 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.535390 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.535705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.536022 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.536338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.536647 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.536966 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.537282 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.537614 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.537942 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.538941 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.539310 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.539528 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.539750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.540059 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.540381 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.540753 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.541006 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.541468 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.541664 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.541992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.542310 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.542470 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 06:36:21.542940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.543126 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 06:36:21.543297 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.543651 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 06:36:21.543810 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.543971 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 06:36:21.544123 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.544269 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 06:36:21.544413 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.544575 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.544805 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.544963 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.545206 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.545407 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.545654 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.545812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.545964 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.545964 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.546252 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.546411 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.546555 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.546699 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.546856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.547002 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.547002 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.547289 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.547450 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.547634 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.547986 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.548138 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.548293 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.548448 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.548592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.548742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850605-1-iscsi {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.548898 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.549043 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.549187 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.549187 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.549502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.549655 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.549811 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.549954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.550098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.550248 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.550409 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.550639 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.550806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.551027 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.551175 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.551318 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.551484 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.551821 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.551971 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.552123 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.552275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.552426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.552579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.552729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.552880 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.553030 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.553180 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.553371 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.553580 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.553957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.554145 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.554343 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.554343 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.554626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.554797 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.555021 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.555207 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.555423 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.555571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.555808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850605-1-iscsi {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.555966 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.556111 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.556271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.556428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.556587 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.556731 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.556874 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.557017 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.557167 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.557402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.557570 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.557725 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.557879 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.558030 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.558181 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.558335 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.558492 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.558652 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.558809 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.558962 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.559120 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.559265 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.559415 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.559569 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.559713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.559854 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.559996 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.560146 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.560304 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.560459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.560623 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.560841 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.561020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.561229 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.561440 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.561589 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.561757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.562046 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.562196 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.562340 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.562508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.562661 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.562813 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.562967 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.563118 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.563270 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.563422 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.563566 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.563712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.563881 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.563881 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.564345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.564511 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.564671 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.564824 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.564995 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.565226 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.565431 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.565640 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.565814 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.566027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.566181 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.566334 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.566487 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.566643 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.566786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.566930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.567080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.567234 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.567380 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.567524 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.567667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.567868 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.568026 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.568179 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.568338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.568484 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.568638 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.568780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.568930 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.569223 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.569453 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.569598 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.570007 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.570171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.570323 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.570482 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.570634 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.570778 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.571005 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.571166 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.571389 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.571555 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.571701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.571844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.572143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.572143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.572434 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.572578 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.572578 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.572858 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.573007 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.573150 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.573332 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.573482 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.573625 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.573766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.573925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.574073 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.574415 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.574575 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.574727 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.574879 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.575022 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.575189 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.575418 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.575577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.575802 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.575958 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.576199 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.576362 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.576507 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.576657 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.576802 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.576954 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.577105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.577262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.577262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.577592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.577592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.577861 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.578014 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.578167 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.578317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.578469 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.578613 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.578763 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.578907 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.579063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.579208 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.579350 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.579504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.579646 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.579797 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.579941 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.580091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.580234 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.580385 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.580529 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.580681 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.580831 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.580999 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.581214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.581398 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.581631 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.581631 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.581929 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.582220 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.582396 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.582662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.582819 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.582971 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.583116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.583274 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.583427 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.583573 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.583724 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.583895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.584048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.584200 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.584369 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.584682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.584834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.585505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.585794 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.586016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.586183 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.586396 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.586551 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.586720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.586866 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.587023 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.587175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.587320 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.587463 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.587616 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.587760 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.587913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.587913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.588185 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.588341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.588493 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.588651 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.588794 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.588945 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.589097 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.589097 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.589097 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.589612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.589755 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.589896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.590051 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.590204 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.590350 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.590500 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.590662 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.590806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.590948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.591111 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.591338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.591495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.591711 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.591859 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:36:21.592016 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.592314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.592466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.592610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.592842 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.593007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.593162 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.593342 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.593501 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.593827 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.593979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.594124 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.594283 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.594432 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.594759 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.595499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.595662 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.595915 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.596143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.596301 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.596528 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.596678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.596822 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.596974 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.597127 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.597271 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.597438 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.597593 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.597737 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.597894 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.598058 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.598210 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.598362 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.598505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.598658 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.598658 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.598946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.599088 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.599237 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.599389 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.599614 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.599768 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.599918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.600072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.600222 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.600374 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.600538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.600742 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.601517 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.601670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.601873 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.602054 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.602224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.602529 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.602695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.602883 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.603108 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.603270 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.603435 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.603588 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.603738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.603920 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.604073 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.604242 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.604406 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.604556 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.604723 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.605043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.605215 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.605407 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.605563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.605712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.605877 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.606102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.606336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.606516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.606743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.606905 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.607056 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.607212 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.607212 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.607517 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.607675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.607832 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.607982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.608137 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.608297 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.608454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.608610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.608759 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.608925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.609156 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.609353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.609510 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.609681 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.609838 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.609997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.610147 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.610304 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.610455 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.610609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.610758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.610909 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.611057 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.611215 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.611371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.611621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.611777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.611925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.612075 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.612233 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.612449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.612736 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.612892 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.613043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.613287 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.613475 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.613475 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.613768 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.613930 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.614086 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.614249 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.614400 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.614548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.614697 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.614865 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.615128 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.615128 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.615969 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.615969 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.617048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.617048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.617418 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.617575 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.617732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.617882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.618031 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.618180 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.618344 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.618503 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.618661 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.618812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.618962 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.619110 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.619267 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.619441 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.619599 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.619749 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.619899 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.620053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.620220 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.620380 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.620531 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.620680 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.620829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.620991 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.621142 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.621326 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.621496 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.621728 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.621884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.622050 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.622202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.622351 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.622567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.622567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.625530 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.625530 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.625732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.625732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.625882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.625965 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626040 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626267 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626345 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626708 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626794 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626886 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.626973 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627150 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627231 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627304 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627489 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627764 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627848 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.627932 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628015 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628148 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628236 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628421 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628604 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628775 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628867 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.628953 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629037 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629134 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629222 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629626 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629722 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629722 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629889 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.629982 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630159 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630254 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630355 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630448 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630625 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630719 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630804 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630888 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.630979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.631064 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.631146 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.631243 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.631330 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.631421 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.631507 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.631599 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.631685 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.631781 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.631880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.632620 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.633128 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.633222 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.633326 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.633515 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.633604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.633688 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.633772 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.633864 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.633959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634141 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634234 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634327 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634412 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634605 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634698 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634790 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.634978 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635265 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635359 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635638 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635792 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635870 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.635943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636153 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636302 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636395 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636491 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636584 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636671 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636756 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636849 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.636935 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.637031 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.637118 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.637253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.637373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.637481 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.637571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.637741 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.637830 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.637929 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638109 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638295 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638390 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638484 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638572 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638664 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638759 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.638938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639022 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639107 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639107 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639282 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639377 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639463 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639548 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639632 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639904 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.639987 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640071 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640237 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640423 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640522 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640616 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640709 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640809 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640903 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.640988 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.641071 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.641273 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.641435 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.641635 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.641734 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.641948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.642044 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.642262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.642363 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.642570 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.642665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.642880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.642977 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.643198 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.643302 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.643506 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.643600 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.643813 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.643905 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.644124 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.644227 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.644455 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.644556 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.644775 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.644874 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.645082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.645185 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.645424 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.645523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.645746 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.645886 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.646058 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.646198 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.646367 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.646472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.646678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.646780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.646990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.647096 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.647318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.647463 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.647786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.648215 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.648215 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.648398 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.648486 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.648579 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.648675 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.648762 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.648895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.648998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.649210 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.649329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.649611 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.649706 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.649938 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.650034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.650251 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.650354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.650566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.650674 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.650873 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.650974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.651188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.651308 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.651498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.651609 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.651809 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.652085 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.652188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.652418 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.652517 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.652727 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.652828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.653036 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.653137 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.653368 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.653471 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.653696 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.653827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.654033 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.654129 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.654361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.654455 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.654678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.654781 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.654991 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.655160 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.655304 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.655397 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.655611 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.655703 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.655919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.656030 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.656234 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.656371 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.656545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.656649 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.656852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.656955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.657162 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.657255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.657503 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.657609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.657812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.657914 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.658121 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.658222 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.658430 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.658532 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.658738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.658833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.659057 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.659188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.659366 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.659497 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.660196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.660325 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.660477 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.660596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.660710 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.660837 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.660960 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.661082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.661197 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.661345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.661480 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.661604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.661726 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.661848 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.661970 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.662129 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.662262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.662461 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.662583 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.662873 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.663068 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.663229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.663779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.664152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.664263 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.664361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.664456 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.664543 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.664628 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.664720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.664816 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.664903 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.664988 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.665080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.665168 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.665416 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.665535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.665754 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.665849 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.666068 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.666169 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.666389 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.666530 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.666708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.666803 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.667023 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.667117 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.667337 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.667445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.667647 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.667826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.667965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.668068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.668255 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.668358 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.668575 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.668669 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.668891 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.668998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.669202 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.669359 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.669538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.669664 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.669852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.669962 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.670163 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.670266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.670470 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.670577 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.670784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.670879 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.671091 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.671186 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.671406 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.671510 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.671713 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.671813 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.672022 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.672116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.672331 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.672438 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.672645 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.672740 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.672961 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.673062 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.673279 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.673453 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.673621 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.673743 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.673937 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.674059 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.674246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.674344 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.674553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.674780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.674876 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.675103 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.675207 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.675444 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.675546 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.675753 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.675858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.676079 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.676229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.676400 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.676538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.676707 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.676803 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.677020 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.677116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.677346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.677457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.677657 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.677796 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.677966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.678068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.678278 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.678379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.678583 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.678684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.679605 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.679976 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.680068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.680155 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.680241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.680443 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.680553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.680755 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.680857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.681090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.681427 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.681542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.681741 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.681836 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.682051 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.682153 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.682362 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.682471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.682716 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.682818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.683028 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.683124 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.683342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.683453 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.683674 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.683771 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.683986 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.684082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.684298 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.684404 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.684615 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.684715 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.684933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.685034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.685244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.685443 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.685582 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.685666 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.685904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.685987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.686220 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.686321 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.686529 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.686622 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.686841 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.686962 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.687151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.687245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.687478 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.687571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.687788 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.687925 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.688102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.688205 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.688413 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.688515 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.688731 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.688833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.689042 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.689180 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.689372 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.689496 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.689685 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.689800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.689995 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.690090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.690312 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.690406 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.690622 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.690774 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.690937 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.691056 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.691245 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.691373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.691563 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.691669 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.691874 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.691970 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.692189 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.692284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.692504 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.692610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.692817 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.692913 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.693134 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.693229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.693477 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.693575 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.693790 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.693886 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.694123 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.694224 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.695121 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.695619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.695728 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.695818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.695913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.696009 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.696107 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.696194 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.696387 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.696508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.696698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.697067 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.697174 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.697440 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.697539 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.697773 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.697916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.698084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.698188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.698402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.698504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.698718 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.698823 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.699041 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.699148 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.699352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.699446 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.699659 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.699752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.699988 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.700090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.700305 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.700400 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.700623 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.700718 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.700942 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.701037 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.701260 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.701370 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.701603 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.701715 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.701917 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.702011 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.702231 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.702325 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.702540 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.702689 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.702850 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.702945 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.703159 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.703254 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.703471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.703574 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.703784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.703923 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.704098 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.704227 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.704421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.704558 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.704767 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.704889 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.705098 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.705220 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.705448 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.705569 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.705770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.705865 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.706096 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.706197 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.706430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.706531 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.706732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.706835 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.707048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.707186 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.707361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.707462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.707684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.707790 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.707997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.708186 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.708328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.708442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.708619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.708716 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.708941 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.709048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.709261 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.709414 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.709594 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.709701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.709923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.710062 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.710614 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.710726 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.710827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.710922 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.711055 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.711150 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.711374 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.711469 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.711705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.711808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.712023 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.712125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.712359 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.712454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.712709 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.712814 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.713026 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.713120 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.713358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.713471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.713675 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.713781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.713985 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.714079 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.714292 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.714386 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.714607 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.714712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.714914 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.715007 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.715229 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.715323 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.715538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.715714 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.715850 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.715954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.716158 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.716253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.716465 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.716573 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.716775 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.716869 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.717083 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.717224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.717417 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.717523 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.717733 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.717836 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.718039 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.718135 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.718349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.718477 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.718655 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.718792 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.718963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.719058 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.719271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.719366 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.719580 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.719682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.719886 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.719987 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.720192 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.720287 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.720501 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.720596 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.720809 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.720913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.721119 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.721213 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.721453 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.721574 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.721794 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.721916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.722123 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.722226 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.722441 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.722536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.722771 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.722876 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.723090 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.723195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.723410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.723504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.723723 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.723826 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.724035 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.724136 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.724344 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.724446 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.724659 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.724792 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.724968 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.725063 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.725276 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.725391 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.725644 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.725809 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.726345 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.726508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.726599 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.726686 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.726787 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.726875 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.726968 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.727161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.727257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.727469 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.727572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.727798 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.727893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.728113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.728217 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.728424 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.728574 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.728736 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.728878 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.729068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.729171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.729427 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.729527 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.729751 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.729854 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.730068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.730171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.730404 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.730504 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.730725 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.730820 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.731044 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.731147 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.731361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.731456 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.731679 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.731771 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.731997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.732090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.732319 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.732420 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.732635 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.732729 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.732953 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.733055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.733273 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.733408 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.733616 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.733717 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.733939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.734048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.734256 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.734352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.734568 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.734669 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.734888 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.734990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.735213 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.735307 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.735564 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.735766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.735870 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.736102 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.736205 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.736425 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.736519 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.736744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.736848 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.737060 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.737161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.737461 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.737559 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.738140 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 06:36:21.738256 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.738256 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.738601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.738921 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.739238 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.739572 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.739899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.740231 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.740576 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.740908 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.741743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.742114 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.742557 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.742761 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.743082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.743396 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.743717 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.744041 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.744366 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.744685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.745003 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.745448 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.745774 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.746093 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.746409 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.746732 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.747052 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.747383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.747724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.748053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.748375 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.748699 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.749024 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.749589 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.749910 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.750250 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.750583 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.750911 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.751231 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.751558 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.751893 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.752205 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.752514 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.752830 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.753147 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.753481 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.753808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.754122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.754431 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.754757 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.755077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.755623 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.755976 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.756295 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.756629 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.757051 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.757482 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.757712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.758042 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.758356 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.758675 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.758998 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.759318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.759630 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.759942 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.760260 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.760577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.760886 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.761204 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.761541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.761874 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.762186 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.762497 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.762806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.763122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.763433 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.763742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.764053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.764362 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.764678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.764986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.765328 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.765631 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.765949 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.766262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.766577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.766943 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.767273 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.767583 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.767896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.768220 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.768634 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.769097 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.769438 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.769764 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.770118 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.770440 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.770992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.771337 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.771662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.772002 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.772341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.773393 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.773714 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.774028 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.774365 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.774685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.775005 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.775466 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.775771 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.776091 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.776410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.776729 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.777048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.777380 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.777700 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.778018 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.778331 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.778646 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.778963 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.779282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.779626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.779953 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.780315 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.780713 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.781053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.781536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.781811 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.782142 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.782587 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.782957 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.783466 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.783794 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.784111 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.784556 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.785000 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.785356 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.785754 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.786118 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.786490 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.786854 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.787178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.787508 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.787829 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.788731 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.789088 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.789452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.789785 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.790099 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.790411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.790725 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.791047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.791364 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.791681 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.791993 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.792311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.792629 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.792940 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.793252 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.793586 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.793916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.794208 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.794518 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.794829 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.795138 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.795449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.795759 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.796069 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.796383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.796694 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.797005 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.797334 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.797648 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.797957 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.798315 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.798633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.798955 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.799280 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.799600 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.799928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.800243 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.800569 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.800894 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.801221 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.801406 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO dbcounter [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Registered counter for database nova_api Jul 28 06:36:21.801560 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.801885 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.802206 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.802523 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.802840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.803154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.803469 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.804388 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.804739 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.805065 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.805398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.805728 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.806056 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.806382 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.806702 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.807020 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.807357 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.807676 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.807995 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.808312 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.808630 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.808946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.809267 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.809677 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.814411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.814411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.814411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.814411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.814411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.814411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.814411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.814411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.815153 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.815153 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.815153 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.815153 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.815153 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.815153 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.815153 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:36:21.815153 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 06:36:21.824511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_db.sqlalchemy.engines [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:36:21.831251 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writer thread running {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:36:21.878453 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO dbcounter [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Registered counter for database nova_api Jul 28 06:36:21.887879 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.context [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a6e3eabf-f037-414e-9584-b60d50f4a3c2(cell1) {{(pid=124563) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 06:36:21.891986 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:21.893670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:21.894482 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:21.896602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:21.898715 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_db.sqlalchemy.engines [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:36:21.898881 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO dbcounter [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Registered counter for database nova_cell0 Jul 28 06:36:21.902860 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO dbcounter [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Registered counter for database nova_cell1 Jul 28 06:36:21.905586 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writer thread running {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:36:21.910276 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_db.sqlalchemy.engines [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:36:21.911579 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_db.sqlalchemy.engines [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:36:21.919127 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writer thread running {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:36:21.920435 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writer thread running {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:36:21.963841 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.context [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a6e3eabf-f037-414e-9584-b60d50f4a3c2(cell1) {{(pid=124562) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 06:36:21.967993 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:21.969838 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:21.970709 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:21.972923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:21.974965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO dbcounter [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Registered counter for database nova_cell0 Jul 28 06:36:21.979082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO dbcounter [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Registered counter for database nova_cell1 Jul 28 06:36:21.985958 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_db.sqlalchemy.engines [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:36:21.989085 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_db.sqlalchemy.engines [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:36:21.994457 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writer thread running {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:36:22.000246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writer thread running {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:36:22.072471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO dbcounter [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Registered counter for database nova_cell0 Jul 28 06:36:22.079452 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_db.sqlalchemy.engines [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:36:22.083969 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writer thread running {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:36:22.149048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO dbcounter [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Registered counter for database nova_cell0 Jul 28 06:36:22.156035 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_db.sqlalchemy.engines [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:36:22.160759 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writer thread running {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:36:22.406814 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: WARNING keystonemiddleware.auth_token [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:36:22.414310 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: WARNING keystonemiddleware.auth_token [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:36:22.479965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: WARNING keystonemiddleware.auth_token [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:36:22.487273 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: WARNING keystonemiddleware.auth_token [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:36:22.759370 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: WARNING keystonemiddleware.auth_token [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:36:22.765488 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: WARNING keystonemiddleware.auth_token [None req-8dcf59cc-51b9-42fd-acad-94e572832ec1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:36:22.770944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f7771bd9c0 pid: 124563 (default app) Jul 28 06:36:22.830337 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: WARNING keystonemiddleware.auth_token [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:36:22.837141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: WARNING keystonemiddleware.auth_token [None req-efc4e393-6aae-43fb-941d-2b6a2b81f3ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:36:22.842529 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f7771bd9c0 pid: 124562 (default app) Jul 28 06:37:04.413726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=3 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:04.415999 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=3 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:04.417577 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=3 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:04.419652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=3 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:06.256416 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7befca39-38b4-4531-a024-6ffae4f1b63a tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Action: 'create', calling method: .version_select at 0x7f574d771ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1168415754"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:08.674976 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7befca39-38b4-4531-a024-6ffae4f1b63a tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.281578 Jul 28 06:37:08.688669 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Jul 28 06:37:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4297 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 06:37:09.237567 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cbedfab3-df86-4d72-8753-1efe0599e888 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d838820>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:09.267014 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:09.268302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:09.269547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:09.272419 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:10.366804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cbedfab3-df86-4d72-8753-1efe0599e888 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab" status: 200 len: 346 microversion: 2.1 time: 1.675855 Jul 28 06:37:10.368637 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:37:08 2022] GET /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab => generated 346 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:10.382914 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-878a08c3-85a3-454c-bc69-ef79f26ac8b0 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Action: 'create', calling method: .version_select at 0x7f574d5d9a60>, body: {"snapshot": {"volume_id": "e3f03bfb-8564-417e-b059-7048f4237cab", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-519928670"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:10.883012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-878a08c3-85a3-454c-bc69-ef79f26ac8b0 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.505249 Jul 28 06:37:10.883978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1162 bytes} [Thu Jul 28 06:37:10 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:10.894925 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9a5c6b09-8541-4391-97eb-da8d1e05f1b2 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d676b80>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:10.956728 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9a5c6b09-8541-4391-97eb-da8d1e05f1b2 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e" status: 200 len: 286 microversion: 2.1 time: 0.066040 Jul 28 06:37:10.957839 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Jul 28 06:37:10 2022] GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:10.970712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ecddbfbc-4a6f-4d34-b2b3-810a86fd0115 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5ecc10>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:11.070726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ecddbfbc-4a6f-4d34-b2b3-810a86fd0115 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.105112 Jul 28 06:37:11.081805 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1140 bytes} [Thu Jul 28 06:37:10 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:11.084492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a1bbc9ae-386a-4590-a187-e9b4e8d381ec tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d676d30>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:11.157231 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a1bbc9ae-386a-4590-a187-e9b4e8d381ec tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e" status: 200 len: 286 microversion: 2.1 time: 0.077899 Jul 28 06:37:11.159267 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Jul 28 06:37:11 2022] GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:12.173912 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4d583d54-6ee1-4b30-997e-2dec5eed3aa1 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5ecaf0>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:12.283550 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4d583d54-6ee1-4b30-997e-2dec5eed3aa1 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e" status: 200 len: 286 microversion: 2.1 time: 0.113567 Jul 28 06:37:12.284162 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Jul 28 06:37:12 2022] GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:13.296544 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c19b32fd-df83-40a8-89c1-3758e002cd91 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5d13a0>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:13.368801 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c19b32fd-df83-40a8-89c1-3758e002cd91 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e" status: 200 len: 286 microversion: 2.1 time: 0.075902 Jul 28 06:37:13.371499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Jul 28 06:37:13 2022] GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:14.383789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-548fc2d8-adb1-4b66-8ee6-951f107fde74 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5ec4c0>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:14.460331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-548fc2d8-adb1-4b66-8ee6-951f107fde74 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e" status: 200 len: 287 microversion: 2.1 time: 0.078361 Jul 28 06:37:14.462170 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Jul 28 06:37:14 2022] GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:14.476673 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0ab4acc3-1642-41fe-8826-afef86c9644c tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5d1a60>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:14.632416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0ab4acc3-1642-41fe-8826-afef86c9644c tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e" status: 202 len: 0 microversion: 2.1 time: 0.162332 Jul 28 06:37:14.633109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Jul 28 06:37:14 2022] DELETE /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:37:14.648175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3a6c5e15-607d-4773-9e2d-6b73aa1e8cdb tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5d9e50>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:14.766261 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3a6c5e15-607d-4773-9e2d-6b73aa1e8cdb tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e" status: 200 len: 286 microversion: 2.1 time: 0.127764 Jul 28 06:37:14.766828 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Jul 28 06:37:14 2022] GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e => generated 286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:15.780824 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6871b29a-8a53-41fa-b3c4-1216cdeef793 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5dd160>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:15.832837 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-6871b29a-8a53-41fa-b3c4-1216cdeef793 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] HTTP exception thrown: Snapshot d812261f-af61-4a42-b086-fe7187900d1e could not be found. Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6871b29a-8a53-41fa-b3c4-1216cdeef793 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Request method failure captured: Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e HTTP/1.1 Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6Ql9_WD0li4IdFIn7TXC5vGDzasnIKfVzFkSRTER1ATxjVereDv5oYKQVnMepQ8DJZjQZ82iSREJ7qOMfkOXMXayfl3UvVBnBnIyy9zmwJeK7X0Za_K2JSZ99kpt6m68Bjzm4FiYJJo2UWfnzJ4YzvC0bwAWs3aM4mPJk_jZY1quA Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: a13254920b734a24948b0bdcad37f37b Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:37:15.839536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a13254920b734a24948b0bdcad37f37b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a13254920b734a24948b0bdcad37f37b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a13254920b734a24948b0bdcad37f37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a13254920b734a24948b0bdcad37f37b"}]}] Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: a13254920b734a24948b0bdcad37f37b Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-VolumesSnapshotsTestJSON-1804928198-project Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 6ba9ce6cb5404b358a3c9591a7aa1775 Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1804928198-project Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Snapshot d812261f-af61-4a42-b086-fe7187900d1e could not be found. Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': 'd812261f-af61-4a42-b086-fe7187900d1e'} Jul 28 06:37:15.840617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d812261f-af61-4a42-b086-fe7187900d1e could not be found. (HTTP 404) (Request-ID: req-21340e94-5a3f-4f8f-b557-48e7ab786bae) Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:15.841314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:37:15.842303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d812261f-af61-4a42-b086-fe7187900d1e could not be found. Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 06:37:15.843323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d812261f-af61-4a42-b086-fe7187900d1e could not be found. Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d812261f-af61-4a42-b086-fe7187900d1e could not be found. Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:15.844282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6871b29a-8a53-41fa-b3c4-1216cdeef793 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Returning 404 to user: Snapshot d812261f-af61-4a42-b086-fe7187900d1e could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:37:15.846490 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6871b29a-8a53-41fa-b3c4-1216cdeef793 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e" status: 404 len: 111 microversion: 2.1 time: 0.070746 Jul 28 06:37:15.850618 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Jul 28 06:37:15 2022] GET /compute/v2.1/os-snapshots/d812261f-af61-4a42-b086-fe7187900d1e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:37:15.859870 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8b66ddb2-49d7-4f33-8608-38e303544cef tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5d9ca0>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:16.038266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8b66ddb2-49d7-4f33-8608-38e303544cef tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab" status: 202 len: 0 microversion: 2.1 time: 0.183253 Jul 28 06:37:16.039928 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Jul 28 06:37:15 2022] DELETE /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:37:16.048940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-717a683b-8137-478d-838f-97e6f5f6cec6 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5ec4c0>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:16.234365 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-717a683b-8137-478d-838f-97e6f5f6cec6 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab" status: 200 len: 345 microversion: 2.1 time: 0.190164 Jul 28 06:37:16.234926 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:37:16 2022] GET /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab => generated 345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:37:16.523742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3c2ee03b-431b-4368-9f62-9de59e90dbec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Action: 'create', calling method: .version_select at 0x7f574d5dddc0>, body: {"keypair": {"name": "tempest-keypair-1528991387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcH/eFqT1+rqoqLNaWTDAlPUD8KrA9mnuMz7bLnr7HS0sa7zfSEGoTh23mSoldaY1z6PK36MUhF5FA0TqYS6G/U3u6PFMEA9eOHpBFc32vaPpPQ7G72tRrL8nWiqU8ziQ=="}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:16.650665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-3c2ee03b-431b-4368-9f62-9de59e90dbec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Getting quotas for project d9e0dc09f9844b57bf7b38a5d4e54e17. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:37:16.667947 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-3c2ee03b-431b-4368-9f62-9de59e90dbec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Getting quotas for user cf13ae714ad04d6696c273603bba9fbc and project d9e0dc09f9844b57bf7b38a5d4e54e17. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:37:16.775018 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3c2ee03b-431b-4368-9f62-9de59e90dbec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.844900 Jul 28 06:37:16.777725 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 7/15] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Jul 28 06:37:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 847 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 28 06:37:17.249491 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-51d565e7-966e-47e7-a159-fd59b6685dbe tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5ecaf0>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:17.327466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-51d565e7-966e-47e7-a159-fd59b6685dbe tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] HTTP exception thrown: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-51d565e7-966e-47e7-a159-fd59b6685dbe tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Request method failure captured: Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab HTTP/1.1 Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6Ql9_WD0li4IdFIn7TXC5vGDzasnIKfVzFkSRTER1ATxjVereDv5oYKQVnMepQ8DJZjQZ82iSREJ7qOMfkOXMXayfl3UvVBnBnIyy9zmwJeK7X0Za_K2JSZ99kpt6m68Bjzm4FiYJJo2UWfnzJ4YzvC0bwAWs3aM4mPJk_jZY1quA Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: a13254920b734a24948b0bdcad37f37b Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:37:17.331667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a13254920b734a24948b0bdcad37f37b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a13254920b734a24948b0bdcad37f37b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a13254920b734a24948b0bdcad37f37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a13254920b734a24948b0bdcad37f37b"}]}] Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: a13254920b734a24948b0bdcad37f37b Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-VolumesSnapshotsTestJSON-1804928198-project Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 6ba9ce6cb5404b358a3c9591a7aa1775 Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1804928198-project Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': 'e3f03bfb-8564-417e-b059-7048f4237cab'} Jul 28 06:37:17.333105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. (HTTP 404) (Request-ID: req-0adebc0c-3ef5-4a7b-a3df-e1d8113bf13b) Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:17.333980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:37:17.335151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 06:37:17.336355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-51d565e7-966e-47e7-a159-fd59b6685dbe tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Returning 404 to user: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-51d565e7-966e-47e7-a159-fd59b6685dbe tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab" status: 404 len: 109 microversion: 2.1 time: 0.087665 Jul 28 06:37:17.337852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:37:17 2022] GET /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:37:17.343435 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d036239f-13b5-4a5b-8d76-487042d7d598 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d54c160>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:17.405383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-d036239f-13b5-4a5b-8d76-487042d7d598 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] HTTP exception thrown: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d036239f-13b5-4a5b-8d76-487042d7d598 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Request method failure captured: Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab HTTP/1.1 Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6Ql9_WD0li4IdFIn7TXC5vGDzasnIKfVzFkSRTER1ATxjVereDv5oYKQVnMepQ8DJZjQZ82iSREJ7qOMfkOXMXayfl3UvVBnBnIyy9zmwJeK7X0Za_K2JSZ99kpt6m68Bjzm4FiYJJo2UWfnzJ4YzvC0bwAWs3aM4mPJk_jZY1quA Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: a13254920b734a24948b0bdcad37f37b Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:37:17.408257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a13254920b734a24948b0bdcad37f37b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a13254920b734a24948b0bdcad37f37b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a13254920b734a24948b0bdcad37f37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a13254920b734a24948b0bdcad37f37b"}]}] Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: a13254920b734a24948b0bdcad37f37b Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-VolumesSnapshotsTestJSON-1804928198-project Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 6ba9ce6cb5404b358a3c9591a7aa1775 Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1804928198-project Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': 'e3f03bfb-8564-417e-b059-7048f4237cab'} Jul 28 06:37:17.409505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. (HTTP 404) (Request-ID: req-39d3b563-4611-4950-b615-c01620728f37) Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:17.410323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:37:17.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 06:37:17.412965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.414063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.415567 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d036239f-13b5-4a5b-8d76-487042d7d598 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Returning 404 to user: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:37:17.416644 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d036239f-13b5-4a5b-8d76-487042d7d598 tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab" status: 404 len: 109 microversion: 2.1 time: 0.077418 Jul 28 06:37:17.420602 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 8/17] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Jul 28 06:37:17 2022] DELETE /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:37:17.428016 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8831e0bb-690c-4e05-9c39-861e27fd70bc tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Calling method '.version_select at 0x7f574d5f1790>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:17.483310 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-8831e0bb-690c-4e05-9c39-861e27fd70bc tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] HTTP exception thrown: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8831e0bb-690c-4e05-9c39-861e27fd70bc tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Request method failure captured: Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab HTTP/1.1 Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6Ql9_WD0li4IdFIn7TXC5vGDzasnIKfVzFkSRTER1ATxjVereDv5oYKQVnMepQ8DJZjQZ82iSREJ7qOMfkOXMXayfl3UvVBnBnIyy9zmwJeK7X0Za_K2JSZ99kpt6m68Bjzm4FiYJJo2UWfnzJ4YzvC0bwAWs3aM4mPJk_jZY1quA Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: a13254920b734a24948b0bdcad37f37b Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:37:17.486471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a13254920b734a24948b0bdcad37f37b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a13254920b734a24948b0bdcad37f37b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a13254920b734a24948b0bdcad37f37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a13254920b734a24948b0bdcad37f37b"}]}] Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: a13254920b734a24948b0bdcad37f37b Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1804928198 Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-VolumesSnapshotsTestJSON-1804928198-project Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 6ba9ce6cb5404b358a3c9591a7aa1775 Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1804928198-project Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': 'e3f03bfb-8564-417e-b059-7048f4237cab'} Jul 28 06:37:17.487693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. (HTTP 404) (Request-ID: req-bf6a113e-ef03-4499-8802-12483277ff50) Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:17.488442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:37:17.490065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 06:37:17.491553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. Jul 28 06:37:17.492545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:37:17.499665 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8831e0bb-690c-4e05-9c39-861e27fd70bc tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] Returning 404 to user: Volume e3f03bfb-8564-417e-b059-7048f4237cab could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:37:17.501081 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8831e0bb-690c-4e05-9c39-861e27fd70bc tempest-VolumesSnapshotsTestJSON-1804928198 tempest-VolumesSnapshotsTestJSON-1804928198-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab" status: 404 len: 109 microversion: 2.1 time: 0.079517 Jul 28 06:37:17.502099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:37:17 2022] GET /compute/v2.1/os-volumes/e3f03bfb-8564-417e-b059-7048f4237cab => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:37:22.234613 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-564944532", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85e85b9c-60b1-412d-a087-859c9e65f8e8"}], "security_groups": [{"name": "tempest-securitygroup--536197960"}], "key_name": "tempest-keypair-1528991387", "user_data": "}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:22.284606 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-460680871", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:22.540062 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.network.neutron [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] validate_networks() for [('2e0d957c-26b4-458e-ac0c-afc92b508943', None, None, None, None, None)] {{(pid=124562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:37:22.736710 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] validate_networks() for [('85e85b9c-60b1-412d-a087-859c9e65f8e8', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:37:24.129317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:37:24.130012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:37:24.130459 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:37:24.130851 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:37:24.131509 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:37:24.157625 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:24.158981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:24.159369 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:24.160073 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:24.255571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Getting quotas for project d9e0dc09f9844b57bf7b38a5d4e54e17. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:37:24.265798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Getting quotas for user cf13ae714ad04d6696c273603bba9fbc and project d9e0dc09f9844b57bf7b38a5d4e54e17. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:37:24.283630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:37:24.298266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:37:24.530058 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c706630e-98c7-4163-b584-2b6b629b560e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.300591 Jul 28 06:37:24.531480 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 11/19] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Jul 28 06:37:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 06:37:25.289599 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-563330025", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "networks": [{"uuid": "9ae3b2a0-c8ca-4ed6-a3e6-e977d5466ce7"}]}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:25.469148 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] validate_networks() for [('9ae3b2a0-c8ca-4ed6-a3e6-e977d5466ce7', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:37:26.004601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Flavor limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:37:26.006695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Image limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:37:26.007178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Flavor pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:37:26.007789 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Image pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:37:26.008347 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:37:26.042049 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:26.050382 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:26.056497 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:26.057407 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:26.155594 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Getting quotas for project 0fb2f4ad616e43f5a9a248390bd0aebf. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:37:26.170575 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Getting quotas for user a2080efc6cbd471995593012bc268765 and project 0fb2f4ad616e43f5a9a248390bd0aebf. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:37:26.226302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Going to run 1 instances... {{(pid=124562) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:37:26.237753 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:37:26.527146 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-87dda33a-371f-43c1-99b6-16ec747677a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.842960 Jul 28 06:37:26.532902 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 9/20] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:37:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 4850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:37:26.571106 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-189cb531-f4d1-4740-aa91-6139c2611388 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:26.591369 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-189cb531-f4d1-4740-aa91-6139c2611388 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:26.980277 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-189cb531-f4d1-4740-aa91-6139c2611388 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:27.061695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-189cb531-f4d1-4740-aa91-6139c2611388 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:27.065610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-189cb531-f4d1-4740-aa91-6139c2611388 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:27.067013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-189cb531-f4d1-4740-aa91-6139c2611388 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1281 microversion: 2.20 time: 0.532098 Jul 28 06:37:27.068894 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 10/21] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:26 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1281 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:27.074743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2e479ce7-98b7-4c48-bd2d-a16069ea8ef5 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c4231f0>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:27.219570 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2e479ce7-98b7-4c48-bd2d-a16069ea8ef5 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/964cf950-b9b5-4ac4-bcba-7f5ad0b662ff" status: 200 len: 350 microversion: 2.1 time: 0.149075 Jul 28 06:37:27.220336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 11/22] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:37:27 2022] GET /compute/v2.1/os-volumes/964cf950-b9b5-4ac4-bcba-7f5ad0b662ff => generated 350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:27.228464 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-31c94419-abe3-4c95-8162-f67cc2cb9ed4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:27.229882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-31c94419-abe3-4c95-8162-f67cc2cb9ed4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:27.476107 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-31c94419-abe3-4c95-8162-f67cc2cb9ed4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:27.486702 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-31c94419-abe3-4c95-8162-f67cc2cb9ed4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1221 microversion: 2.1 time: 0.265309 Jul 28 06:37:27.505707 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:27 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1221 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:28.204648 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4fa6a74f-9c3d-4828-95ee-93d97cd6dd96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: .version_select at 0x7f574c423dc0>, body: {"keypair": {"name": "tempest-keypair-786599056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuyRI4v+hkigVCnHP6GcqPymswVHyx/qi3OBaa+dQCT25WWpnfa3UnwaOOdK5Ge8elVroDH+c1l1nNrBK8aooHpDVPZekFaJcohDmlCk0vbs7z0d5Soygx/drE6QDE38g=="}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:28.245108 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:37:28.245747 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:37:28.246307 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:37:28.246823 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:37:28.253805 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:37:28.278185 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:28.281584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:28.282383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-4fa6a74f-9c3d-4828-95ee-93d97cd6dd96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:37:28.283817 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:28.284373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:28.296579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-4fa6a74f-9c3d-4828-95ee-93d97cd6dd96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for user 4a1db92e28444854b9de817dd36104ea and project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:37:28.355844 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Getting quotas for project a0e7a5dae78a4c10926c6fb66458c71b. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:37:28.370890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Getting quotas for user b240f68acc734bd492843ad4ac35807c and project a0e7a5dae78a4c10926c6fb66458c71b. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:37:28.384384 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4fa6a74f-9c3d-4828-95ee-93d97cd6dd96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.886868 Jul 28 06:37:28.385245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 13/24] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Jul 28 06:37:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:28.404288 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-629475125", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:28.470840 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:37:28.480268 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:37:28.593676 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.network.neutron [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] validate_networks() for [('2e0d957c-26b4-458e-ac0c-afc92b508943', None, None, None, None, None)] {{(pid=124562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:37:28.689871 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-70613376-d327-41db-9efb-78b0768d7f80 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.156240 Jul 28 06:37:28.699296 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 12/25] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:37:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 4166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:37:28.730211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-13f3cbf1-6f57-4efd-b6fa-520b22fc0146 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:28.764630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-13f3cbf1-6f57-4efd-b6fa-520b22fc0146 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:28.872852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13f3cbf1-6f57-4efd-b6fa-520b22fc0146 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:28.873338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13f3cbf1-6f57-4efd-b6fa-520b22fc0146 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:28.874151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13f3cbf1-6f57-4efd-b6fa-520b22fc0146 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:28.876701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13f3cbf1-6f57-4efd-b6fa-520b22fc0146 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:29.663470 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-13f3cbf1-6f57-4efd-b6fa-520b22fc0146 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:29.696791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-13f3cbf1-6f57-4efd-b6fa-520b22fc0146 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:29.698641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-13f3cbf1-6f57-4efd-b6fa-520b22fc0146 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:29.700276 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-13f3cbf1-6f57-4efd-b6fa-520b22fc0146 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1277 microversion: 2.20 time: 0.999776 Jul 28 06:37:29.701947 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 13/26] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:28 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1277 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:29.722686 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e103c1a0-f99d-48d7-927a-13bd163ad109 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:29.723631 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e103c1a0-f99d-48d7-927a-13bd163ad109 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:29.831258 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e103c1a0-f99d-48d7-927a-13bd163ad109 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:29.862406 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e103c1a0-f99d-48d7-927a-13bd163ad109 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1214 microversion: 2.1 time: 0.158832 Jul 28 06:37:29.865705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:29 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:29.873150 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-bafe95c0-eb7a-48b8-92d3-fba1ee759256 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c39e9d0>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:29.892467 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Flavor limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:37:29.892940 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Image limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:37:29.893371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Flavor pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:37:29.893783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Image pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:37:29.894189 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:37:29.907804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:29.913158 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:29.914372 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:29.914898 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:29.959967 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Getting quotas for project 0fb2f4ad616e43f5a9a248390bd0aebf. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:37:29.980587 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Getting quotas for user a2080efc6cbd471995593012bc268765 and project 0fb2f4ad616e43f5a9a248390bd0aebf. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:37:29.982773 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-bafe95c0-eb7a-48b8-92d3-fba1ee759256 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/9da9f0a8-c029-4f60-b726-8b0d6dc869ce" status: 200 len: 350 microversion: 2.1 time: 0.115816 Jul 28 06:37:29.997071 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 15/28] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:37:29 2022] GET /compute/v2.1/os-volumes/9da9f0a8-c029-4f60-b726-8b0d6dc869ce => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:30.039223 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Going to run 1 instances... {{(pid=124562) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:37:30.055639 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:37:30.265759 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1db90c92-062c-4ca2-a3f4-c36ccbfc9ae1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.870684 Jul 28 06:37:30.269396 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 14/29] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:37:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:37:30.280834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e8f43fa3-5e2c-4a5c-8fe0-e88ea3aabf70 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:30.281876 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e8f43fa3-5e2c-4a5c-8fe0-e88ea3aabf70 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:30.718697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e8f43fa3-5e2c-4a5c-8fe0-e88ea3aabf70 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:30.730667 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3271492f-d114-4c6f-8be3-3b7acdc9f445 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:30.731543 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3271492f-d114-4c6f-8be3-3b7acdc9f445 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:30.740575 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e8f43fa3-5e2c-4a5c-8fe0-e88ea3aabf70 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1221 microversion: 2.1 time: 0.466300 Jul 28 06:37:30.751660 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3271492f-d114-4c6f-8be3-3b7acdc9f445 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:30.752110 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3271492f-d114-4c6f-8be3-3b7acdc9f445 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:30.752894 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3271492f-d114-4c6f-8be3-3b7acdc9f445 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:30.753345 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3271492f-d114-4c6f-8be3-3b7acdc9f445 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:30.753800 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 16/30] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:30 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1221 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:30.886869 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a639d51e-44c2-4a45-9ceb-30eeaaeafab9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:30.887720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a639d51e-44c2-4a45-9ceb-30eeaaeafab9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:30.913288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a639d51e-44c2-4a45-9ceb-30eeaaeafab9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:30.913992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a639d51e-44c2-4a45-9ceb-30eeaaeafab9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:30.914850 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a639d51e-44c2-4a45-9ceb-30eeaaeafab9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:30.915299 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a639d51e-44c2-4a45-9ceb-30eeaaeafab9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:31.388994 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a639d51e-44c2-4a45-9ceb-30eeaaeafab9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:31.429679 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a639d51e-44c2-4a45-9ceb-30eeaaeafab9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1210 microversion: 2.1 time: 0.546672 Jul 28 06:37:31.430699 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 17/31] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:30 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1210 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:31.528552 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3271492f-d114-4c6f-8be3-3b7acdc9f445 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:31.569724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3271492f-d114-4c6f-8be3-3b7acdc9f445 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:31.577061 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3271492f-d114-4c6f-8be3-3b7acdc9f445 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:31.584132 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3271492f-d114-4c6f-8be3-3b7acdc9f445 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1339 microversion: 2.20 time: 0.854903 Jul 28 06:37:31.597971 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 15/32] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:30 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1339 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:31.779892 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-87cc1f3a-441b-4486-8f10-6220518c05a4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:31.783784 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-87cc1f3a-441b-4486-8f10-6220518c05a4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:31.819032 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-87cc1f3a-441b-4486-8f10-6220518c05a4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:31.822342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-87cc1f3a-441b-4486-8f10-6220518c05a4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:31.833991 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-87cc1f3a-441b-4486-8f10-6220518c05a4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:31.836445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-87cc1f3a-441b-4486-8f10-6220518c05a4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:32.261650 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-96ee9dea-6225-4c38-bba3-c101a3ce7e0d tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c3b6ca0>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:32.294729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-87cc1f3a-441b-4486-8f10-6220518c05a4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:32.310833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-87cc1f3a-441b-4486-8f10-6220518c05a4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1225 microversion: 2.1 time: 0.536908 Jul 28 06:37:32.312812 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 18/33] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:31 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1225 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:32.447504 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-96ee9dea-6225-4c38-bba3-c101a3ce7e0d tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/1fbedcb9-a97b-41ad-85d9-6bf72da86599" status: 200 len: 350 microversion: 2.1 time: 0.192355 Jul 28 06:37:32.448118 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 16/34] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:37:32 2022] GET /compute/v2.1/os-volumes/1fbedcb9-a97b-41ad-85d9-6bf72da86599 => generated 350 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:32.461947 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8f08c2ab-b10a-4bc3-9508-1ccd856eba0e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:32.462733 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8f08c2ab-b10a-4bc3-9508-1ccd856eba0e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:32.468638 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-304f386a-679d-40c8-a1bb-3235a7c517fc tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c3b60d0>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:32.475082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8f08c2ab-b10a-4bc3-9508-1ccd856eba0e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:32.485173 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8f08c2ab-b10a-4bc3-9508-1ccd856eba0e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:32.493177 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8f08c2ab-b10a-4bc3-9508-1ccd856eba0e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:32.494079 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8f08c2ab-b10a-4bc3-9508-1ccd856eba0e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:32.667553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-304f386a-679d-40c8-a1bb-3235a7c517fc tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.210104 Jul 28 06:37:32.669743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 17/35] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Jul 28 06:37:32 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:32.679922 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4fbfb027-aeca-443b-bd0b-7f4b4898ccbb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:32.680806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4fbfb027-aeca-443b-bd0b-7f4b4898ccbb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:32.731246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4fbfb027-aeca-443b-bd0b-7f4b4898ccbb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:32.731790 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4fbfb027-aeca-443b-bd0b-7f4b4898ccbb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:32.732829 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4fbfb027-aeca-443b-bd0b-7f4b4898ccbb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:32.733543 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4fbfb027-aeca-443b-bd0b-7f4b4898ccbb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:32.912034 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8f08c2ab-b10a-4bc3-9508-1ccd856eba0e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:32.923744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8f08c2ab-b10a-4bc3-9508-1ccd856eba0e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1272 microversion: 2.1 time: 0.475199 Jul 28 06:37:32.924333 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 19/36] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:32 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1272 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:32.959722 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0966875f-c7a6-4cf8-b431-700eb7e78e64 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c3634c0>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:33.309081 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0966875f-c7a6-4cf8-b431-700eb7e78e64 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.383667 Jul 28 06:37:33.319249 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 20/37] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Jul 28 06:37:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:33.324770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3d2c4c65-90c0-4032-bc94-8d2e23fecebb tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c31aa60>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:33.733257 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3d2c4c65-90c0-4032-bc94-8d2e23fecebb tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.412248 Jul 28 06:37:33.734088 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 21/38] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Jul 28 06:37:33 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:33.739683 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-03b43ee4-a318-4440-9862-059518fc4f56 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:33.740518 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-03b43ee4-a318-4440-9862-059518fc4f56 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:33.760687 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03b43ee4-a318-4440-9862-059518fc4f56 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:33.763883 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03b43ee4-a318-4440-9862-059518fc4f56 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:33.765754 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03b43ee4-a318-4440-9862-059518fc4f56 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:33.769066 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03b43ee4-a318-4440-9862-059518fc4f56 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:34.000779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4fbfb027-aeca-443b-bd0b-7f4b4898ccbb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:34.016228 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4fbfb027-aeca-443b-bd0b-7f4b4898ccbb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:34.023675 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4fbfb027-aeca-443b-bd0b-7f4b4898ccbb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:34.027655 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4fbfb027-aeca-443b-bd0b-7f4b4898ccbb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1339 microversion: 2.20 time: 1.355371 Jul 28 06:37:34.028835 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 18/39] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:32 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1339 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:34.056848 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-03109e17-5ea5-467e-bd02-6eb931aab58a tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c3aab80>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:34.374277 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-03b43ee4-a318-4440-9862-059518fc4f56 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:34.391811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-03b43ee4-a318-4440-9862-059518fc4f56 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1279 microversion: 2.1 time: 0.655711 Jul 28 06:37:34.397714 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 22/40] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:33 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1279 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:34.431163 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-da6aa9fb-da33-4c70-9429-a6d0199a3ff0 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:34.433229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-da6aa9fb-da33-4c70-9429-a6d0199a3ff0 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:34.448676 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-da6aa9fb-da33-4c70-9429-a6d0199a3ff0 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:34.449407 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-da6aa9fb-da33-4c70-9429-a6d0199a3ff0 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:34.450409 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-da6aa9fb-da33-4c70-9429-a6d0199a3ff0 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:34.453013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-da6aa9fb-da33-4c70-9429-a6d0199a3ff0 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:34.872288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-da6aa9fb-da33-4c70-9429-a6d0199a3ff0 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:34.880951 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-da6aa9fb-da33-4c70-9429-a6d0199a3ff0 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1272 microversion: 2.1 time: 0.481993 Jul 28 06:37:34.904635 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 23/41] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:34 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1272 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:34.995722 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-03109e17-5ea5-467e-bd02-6eb931aab58a tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.963550 Jul 28 06:37:35.008592 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 19/42] 10.222.0.20 () {58 vars in 1167 bytes} [Thu Jul 28 06:37:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:35.011008 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6d9eff75-15bb-47f9-bd41-286c83888056 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c32b670>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:35.068494 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-820faa38-8052-4c67-87f9-fe80f110e918 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:35.069121 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-820faa38-8052-4c67-87f9-fe80f110e918 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:35.091996 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-820faa38-8052-4c67-87f9-fe80f110e918 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:35.100293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-820faa38-8052-4c67-87f9-fe80f110e918 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:35.104126 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-820faa38-8052-4c67-87f9-fe80f110e918 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:35.105956 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-820faa38-8052-4c67-87f9-fe80f110e918 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:35.374027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-820faa38-8052-4c67-87f9-fe80f110e918 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:35.392542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-820faa38-8052-4c67-87f9-fe80f110e918 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:35.394459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-820faa38-8052-4c67-87f9-fe80f110e918 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:35.396187 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-820faa38-8052-4c67-87f9-fe80f110e918 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1339 microversion: 2.20 time: 0.333463 Jul 28 06:37:35.396751 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 20/43] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:35 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1339 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:35.442146 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c402236e-8ea5-44fa-88c9-94d78f5d79fb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:35.444724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c402236e-8ea5-44fa-88c9-94d78f5d79fb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:35.490638 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c402236e-8ea5-44fa-88c9-94d78f5d79fb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:35.490832 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c402236e-8ea5-44fa-88c9-94d78f5d79fb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:35.506096 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c402236e-8ea5-44fa-88c9-94d78f5d79fb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:35.506775 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c402236e-8ea5-44fa-88c9-94d78f5d79fb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:35.549005 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6d9eff75-15bb-47f9-bd41-286c83888056 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.543379 Jul 28 06:37:35.550987 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 24/44] 10.222.0.20 () {58 vars in 1170 bytes} [Thu Jul 28 06:37:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:37:35.564455 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b057c7a7-2005-4cd0-81d8-20bce6b237ec tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c401dc0>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:35.931658 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b057c7a7-2005-4cd0-81d8-20bce6b237ec tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.369392 Jul 28 06:37:35.932937 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 25/45] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Jul 28 06:37:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:35.947957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9ae27fee-c2ec-4682-8d81-a330da4d1986 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:35.950748 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9ae27fee-c2ec-4682-8d81-a330da4d1986 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:35.983731 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9ae27fee-c2ec-4682-8d81-a330da4d1986 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:35.984551 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9ae27fee-c2ec-4682-8d81-a330da4d1986 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:35.986424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9ae27fee-c2ec-4682-8d81-a330da4d1986 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:35.987573 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9ae27fee-c2ec-4682-8d81-a330da4d1986 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:36.068402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c402236e-8ea5-44fa-88c9-94d78f5d79fb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:36.076684 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c402236e-8ea5-44fa-88c9-94d78f5d79fb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1279 microversion: 2.1 time: 0.651152 Jul 28 06:37:36.077276 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 21/46] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:35 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1279 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:36.114518 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5e845ab3-f73a-4b8a-833f-982af5768901 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c357940>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:36.329181 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5e845ab3-f73a-4b8a-833f-982af5768901 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.231913 Jul 28 06:37:36.329795 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 22/47] 10.222.0.20 () {58 vars in 1188 bytes} [Thu Jul 28 06:37:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:36.348654 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-09f2eba5-2eeb-4cac-8a09-72696a9300f7 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] Calling method '.version_select at 0x7f574c3aaaf0>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:36.594229 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-09f2eba5-2eeb-4cac-8a09-72696a9300f7 tempest-VolumesTestJSON-732929946 tempest-VolumesTestJSON-732929946-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.250172 Jul 28 06:37:36.595052 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Jul 28 06:37:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:36.602498 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-47531c06-09b3-40d3-b8b0-6d11e6e79fa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:36.604722 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-47531c06-09b3-40d3-b8b0-6d11e6e79fa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:36.641964 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-47531c06-09b3-40d3-b8b0-6d11e6e79fa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:36.643034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-47531c06-09b3-40d3-b8b0-6d11e6e79fa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:36.644539 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-47531c06-09b3-40d3-b8b0-6d11e6e79fa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:36.647244 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-47531c06-09b3-40d3-b8b0-6d11e6e79fa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:36.682451 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9ae27fee-c2ec-4682-8d81-a330da4d1986 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:36.698690 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9ae27fee-c2ec-4682-8d81-a330da4d1986 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1272 microversion: 2.1 time: 0.764198 Jul 28 06:37:36.701835 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 26/49] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:35 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1272 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:36.894243 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-939397416", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1658fcaf-8835-445a-a4cf-3f4534b3861e"}], "security_groups": [{"name": "tempest-securitygroup--1614021100"}], "key_name": "tempest-keypair-786599056", "user_data": "}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:37.547742 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] validate_networks() for [('1658fcaf-8835-445a-a4cf-3f4534b3861e', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:37:37.784065 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-47531c06-09b3-40d3-b8b0-6d11e6e79fa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:37.799381 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-47531c06-09b3-40d3-b8b0-6d11e6e79fa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:37.801469 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-47531c06-09b3-40d3-b8b0-6d11e6e79fa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:37.802669 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-47531c06-09b3-40d3-b8b0-6d11e6e79fa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 1.205447 Jul 28 06:37:37.813089 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 24/50] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:36 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:37.822304 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d744bcc8-6e33-40e1-be58-43dedc715613 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:37.823130 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d744bcc8-6e33-40e1-be58-43dedc715613 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:37.838518 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d744bcc8-6e33-40e1-be58-43dedc715613 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:37.840984 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d744bcc8-6e33-40e1-be58-43dedc715613 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:37.842419 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d744bcc8-6e33-40e1-be58-43dedc715613 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:37.846109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d744bcc8-6e33-40e1-be58-43dedc715613 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:38.337982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=4 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:38.806587 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d744bcc8-6e33-40e1-be58-43dedc715613 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:38.858569 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d744bcc8-6e33-40e1-be58-43dedc715613 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 1.050544 Jul 28 06:37:38.878747 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 25/51] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:37 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:38.951085 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-325116d1-4bac-4e4f-ab24-3332e40fb4bb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:38.962814 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-325116d1-4bac-4e4f-ab24-3332e40fb4bb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:39.040785 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-325116d1-4bac-4e4f-ab24-3332e40fb4bb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:39.043555 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-325116d1-4bac-4e4f-ab24-3332e40fb4bb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:39.045098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-325116d1-4bac-4e4f-ab24-3332e40fb4bb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:39.045946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-325116d1-4bac-4e4f-ab24-3332e40fb4bb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:39.136835 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:37:39.138148 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:37:39.139214 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:37:39.141537 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:37:39.142309 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:37:39.211361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:39.212767 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:39.215904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:39.216675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:39.342111 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:37:39.362396 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for user 4a1db92e28444854b9de817dd36104ea and project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:37:39.395416 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:37:39.407114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:37:39.609957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-70e30980-44ad-440c-a635-ba18c8b47b41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.722797 Jul 28 06:37:39.628106 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:37:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:37:39.652360 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f532b8bd-31cf-4a2d-b3da-e30f2ba21487 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:39.677641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f532b8bd-31cf-4a2d-b3da-e30f2ba21487 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:39.697796 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f532b8bd-31cf-4a2d-b3da-e30f2ba21487 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:39.698478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f532b8bd-31cf-4a2d-b3da-e30f2ba21487 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:39.702119 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f532b8bd-31cf-4a2d-b3da-e30f2ba21487 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:39.702823 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f532b8bd-31cf-4a2d-b3da-e30f2ba21487 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:39.935443 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=4 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:40.029912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=24 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:41.506338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f532b8bd-31cf-4a2d-b3da-e30f2ba21487 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:41.540619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f532b8bd-31cf-4a2d-b3da-e30f2ba21487 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:41.550607 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f532b8bd-31cf-4a2d-b3da-e30f2ba21487 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:41.554115 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f532b8bd-31cf-4a2d-b3da-e30f2ba21487 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 1.924666 Jul 28 06:37:41.561008 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 28/53] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:39 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:41.574637 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-41106efc-0c17-46e7-aa8d-cec7ff119213 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:41.581119 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-41106efc-0c17-46e7-aa8d-cec7ff119213 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:41.616676 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41106efc-0c17-46e7-aa8d-cec7ff119213 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:41.618913 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41106efc-0c17-46e7-aa8d-cec7ff119213 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:41.621534 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41106efc-0c17-46e7-aa8d-cec7ff119213 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:41.626997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41106efc-0c17-46e7-aa8d-cec7ff119213 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:41.947556 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-41106efc-0c17-46e7-aa8d-cec7ff119213 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:41.964277 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-41106efc-0c17-46e7-aa8d-cec7ff119213 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1236 microversion: 2.1 time: 0.401831 Jul 28 06:37:41.980432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 29/54] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:41 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1236 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:41.985777 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a434b5e4-66d6-4008-88ba-811472474372 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:41.988237 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a434b5e4-66d6-4008-88ba-811472474372 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:41.998939 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a434b5e4-66d6-4008-88ba-811472474372 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:41.999857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a434b5e4-66d6-4008-88ba-811472474372 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:42.001240 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a434b5e4-66d6-4008-88ba-811472474372 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:42.002055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a434b5e4-66d6-4008-88ba-811472474372 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:42.041808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-325116d1-4bac-4e4f-ab24-3332e40fb4bb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:42.050390 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-325116d1-4bac-4e4f-ab24-3332e40fb4bb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 3.169620 Jul 28 06:37:42.056531 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 26/55] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:38 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 3177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:42.333478 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-1a581725-19eb-4db2-8c93-c30dd2dee58c req-3305da2e-bfc5-4c80-aa14-1e81b097dd7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759d9d29-e67f-49e4-986a-5d71340fd0c3", "tag": "1af3bbc2-bb75-4b78-b8d2-211da789e581"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:42.348613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:42.351037 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-1a581725-19eb-4db2-8c93-c30dd2dee58c req-3305da2e-bfc5-4c80-aa14-1e81b097dd7d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:42.352940 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-1a581725-19eb-4db2-8c93-c30dd2dee58c req-3305da2e-bfc5-4c80-aa14-1e81b097dd7d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:42.377668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-1a581725-19eb-4db2-8c93-c30dd2dee58c req-3305da2e-bfc5-4c80-aa14-1e81b097dd7d service nova] Creating event network-changed:1af3bbc2-bb75-4b78-b8d2-211da789e581 for instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 on hv-cinder-85060 Jul 28 06:37:42.379844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-1a581725-19eb-4db2-8c93-c30dd2dee58c req-3305da2e-bfc5-4c80-aa14-1e81b097dd7d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 06:37:42.381360 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e696afa-cc4b-4e47-9bb5-81ac27ea597c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:42.382750 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e696afa-cc4b-4e47-9bb5-81ac27ea597c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:42.383839 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e696afa-cc4b-4e47-9bb5-81ac27ea597c None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:42.384492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e696afa-cc4b-4e47-9bb5-81ac27ea597c None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:42.398236 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.compute.rpcapi [None req-9e696afa-cc4b-4e47-9bb5-81ac27ea597c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 06:37:42.400590 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e696afa-cc4b-4e47-9bb5-81ac27ea597c None None] Releasing lock "compute-rpcapi-router" {{(pid=124562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 06:37:42.456072 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9e696afa-cc4b-4e47-9bb5-81ac27ea597c None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214312 Jul 28 06:37:42.456762 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 27/56] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:37:42.594080 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-22c862b4-51fa-4a2e-aa6f-901e0327b5f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:42.595225 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-22c862b4-51fa-4a2e-aa6f-901e0327b5f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:42.603760 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-22c862b4-51fa-4a2e-aa6f-901e0327b5f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:42.604726 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-22c862b4-51fa-4a2e-aa6f-901e0327b5f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:42.606926 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-22c862b4-51fa-4a2e-aa6f-901e0327b5f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:42.607655 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-22c862b4-51fa-4a2e-aa6f-901e0327b5f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:42.803926 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-22c862b4-51fa-4a2e-aa6f-901e0327b5f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:42.805014 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a434b5e4-66d6-4008-88ba-811472474372 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:42.814951 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-22c862b4-51fa-4a2e-aa6f-901e0327b5f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:42.819574 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-22c862b4-51fa-4a2e-aa6f-901e0327b5f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:42.820870 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-22c862b4-51fa-4a2e-aa6f-901e0327b5f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.235323 Jul 28 06:37:42.824019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a434b5e4-66d6-4008-88ba-811472474372 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.841893 Jul 28 06:37:42.825751 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 30/57] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:41 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:42.835106 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 28/58] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:42 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:42.999443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5e915e6f-86e4-4599-afa3-9bb81a80b5bc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:43.000445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5e915e6f-86e4-4599-afa3-9bb81a80b5bc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:43.018597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e915e6f-86e4-4599-afa3-9bb81a80b5bc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:43.021343 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e915e6f-86e4-4599-afa3-9bb81a80b5bc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:43.024105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e915e6f-86e4-4599-afa3-9bb81a80b5bc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:43.027270 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e915e6f-86e4-4599-afa3-9bb81a80b5bc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:43.074299 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-97b49c6b-dca0-4ccc-8e87-bec03835f0ea tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:43.075546 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-97b49c6b-dca0-4ccc-8e87-bec03835f0ea tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:43.087007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-97b49c6b-dca0-4ccc-8e87-bec03835f0ea tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:43.087793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-97b49c6b-dca0-4ccc-8e87-bec03835f0ea tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:43.092374 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-97b49c6b-dca0-4ccc-8e87-bec03835f0ea tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:43.092982 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-97b49c6b-dca0-4ccc-8e87-bec03835f0ea tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:43.280702 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5e915e6f-86e4-4599-afa3-9bb81a80b5bc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:43.290350 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-97b49c6b-dca0-4ccc-8e87-bec03835f0ea tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:43.290654 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5e915e6f-86e4-4599-afa3-9bb81a80b5bc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1236 microversion: 2.1 time: 0.307531 Jul 28 06:37:43.291842 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:42 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1236 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:43.298608 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-97b49c6b-dca0-4ccc-8e87-bec03835f0ea tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.229462 Jul 28 06:37:43.299185 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 29/60] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:43 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:43.849731 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-cf62fe3e-e38c-406c-8e87-a2bf4746ef45 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:43.851019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-cf62fe3e-e38c-406c-8e87-a2bf4746ef45 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:43.865659 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf62fe3e-e38c-406c-8e87-a2bf4746ef45 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:43.866833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf62fe3e-e38c-406c-8e87-a2bf4746ef45 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:43.874245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a4d4b961-8d24-429c-a3af-4d09d51b6d01 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:43.874245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a4d4b961-8d24-429c-a3af-4d09d51b6d01 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:43.876473 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf62fe3e-e38c-406c-8e87-a2bf4746ef45 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:43.878744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf62fe3e-e38c-406c-8e87-a2bf4746ef45 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:43.887256 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a4d4b961-8d24-429c-a3af-4d09d51b6d01 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:43.887256 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a4d4b961-8d24-429c-a3af-4d09d51b6d01 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:43.890567 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a4d4b961-8d24-429c-a3af-4d09d51b6d01 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:43.892475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a4d4b961-8d24-429c-a3af-4d09d51b6d01 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:44.221105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-cf62fe3e-e38c-406c-8e87-a2bf4746ef45 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:44.257039 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-cf62fe3e-e38c-406c-8e87-a2bf4746ef45 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.412678 Jul 28 06:37:44.277337 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 32/61] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:43 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:44.278115 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a4d4b961-8d24-429c-a3af-4d09d51b6d01 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:44.305553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a4d4b961-8d24-429c-a3af-4d09d51b6d01 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:44.314142 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a4d4b961-8d24-429c-a3af-4d09d51b6d01 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:44.320082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a4d4b961-8d24-429c-a3af-4d09d51b6d01 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.463441 Jul 28 06:37:44.341274 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 30/62] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:43 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:44.370182 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-33a49131-4245-43e8-bc04-8386bce7a949 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:44.374077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-33a49131-4245-43e8-bc04-8386bce7a949 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:44.411689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-33a49131-4245-43e8-bc04-8386bce7a949 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:44.413339 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-33a49131-4245-43e8-bc04-8386bce7a949 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:44.415158 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-33a49131-4245-43e8-bc04-8386bce7a949 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:44.416741 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-33a49131-4245-43e8-bc04-8386bce7a949 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:44.536162 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-33a49131-4245-43e8-bc04-8386bce7a949 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:44.548941 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-33a49131-4245-43e8-bc04-8386bce7a949 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1292 microversion: 2.1 time: 0.206373 Jul 28 06:37:44.551099 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 31/63] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:44 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1292 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:44.565849 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bac701b2-6977-42bc-81b9-32c68f22d1b3 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:44.566703 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bac701b2-6977-42bc-81b9-32c68f22d1b3 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:44.574423 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bac701b2-6977-42bc-81b9-32c68f22d1b3 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:44.575242 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bac701b2-6977-42bc-81b9-32c68f22d1b3 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:44.576341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bac701b2-6977-42bc-81b9-32c68f22d1b3 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:44.577036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bac701b2-6977-42bc-81b9-32c68f22d1b3 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:44.712109 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-7a613125-e826-4e81-9904-4555e45b21ee req-e7d82adf-28c6-4693-bd3c-72eff5265ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd097e6-598d-42a1-a3ad-5d8716bcb7fc", "tag": "7d4c8835-d4d0-44cd-b343-088c09fffb3a"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:44.725480 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:44.788933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-7a613125-e826-4e81-9904-4555e45b21ee req-e7d82adf-28c6-4693-bd3c-72eff5265ca1 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:44.791716 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-7a613125-e826-4e81-9904-4555e45b21ee req-e7d82adf-28c6-4693-bd3c-72eff5265ca1 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:44.867781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=79 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:44.875772 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-7a613125-e826-4e81-9904-4555e45b21ee req-e7d82adf-28c6-4693-bd3c-72eff5265ca1 service nova] Creating event network-changed:7d4c8835-d4d0-44cd-b343-088c09fffb3a for instance 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc on hv-cinder-85060 Jul 28 06:37:44.876407 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-7a613125-e826-4e81-9904-4555e45b21ee req-e7d82adf-28c6-4693-bd3c-72eff5265ca1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 06:37:44.880759 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-49812e07-f359-4e1c-9422-bc440a3c14cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:44.881821 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-49812e07-f359-4e1c-9422-bc440a3c14cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:44.883409 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-49812e07-f359-4e1c-9422-bc440a3c14cb None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:44.883853 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-49812e07-f359-4e1c-9422-bc440a3c14cb None None] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:44.919538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.compute.rpcapi [None req-49812e07-f359-4e1c-9422-bc440a3c14cb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 06:37:44.922821 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-49812e07-f359-4e1c-9422-bc440a3c14cb None None] Releasing lock "compute-rpcapi-router" {{(pid=124563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 06:37:44.962960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-49812e07-f359-4e1c-9422-bc440a3c14cb None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.695146 Jul 28 06:37:44.964022 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 33/64] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:44.970972 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-a25f8cfb-3cf7-4c91-9a18-75cc04f42798 req-575796ad-bc30-48b8-8622-a44d1ac75ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019e1e9c-7545-477a-bae9-47c555ae07e2", "tag": "626917cf-1bf9-47dd-b3eb-784f6c8fdad0"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:44.990480 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-a25f8cfb-3cf7-4c91-9a18-75cc04f42798 req-575796ad-bc30-48b8-8622-a44d1ac75ba1 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:44.993570 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-a25f8cfb-3cf7-4c91-9a18-75cc04f42798 req-575796ad-bc30-48b8-8622-a44d1ac75ba1 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:45.018050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-a25f8cfb-3cf7-4c91-9a18-75cc04f42798 req-575796ad-bc30-48b8-8622-a44d1ac75ba1 service nova] Creating event network-changed:626917cf-1bf9-47dd-b3eb-784f6c8fdad0 for instance 019e1e9c-7545-477a-bae9-47c555ae07e2 on hv-cinder-85060 Jul 28 06:37:45.029241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-a25f8cfb-3cf7-4c91-9a18-75cc04f42798 req-575796ad-bc30-48b8-8622-a44d1ac75ba1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063254 Jul 28 06:37:45.030354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 34/65] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:45.141282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bac701b2-6977-42bc-81b9-32c68f22d1b3 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:45.150346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bac701b2-6977-42bc-81b9-32c68f22d1b3 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.596981 Jul 28 06:37:45.152730 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 32/66] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:44 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:45.296393 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d477290f-19bf-4361-ab7b-840ada7689b2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:45.297653 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d477290f-19bf-4361-ab7b-840ada7689b2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:45.306810 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d477290f-19bf-4361-ab7b-840ada7689b2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:45.307643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d477290f-19bf-4361-ab7b-840ada7689b2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:45.309463 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d477290f-19bf-4361-ab7b-840ada7689b2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:45.310162 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d477290f-19bf-4361-ab7b-840ada7689b2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:45.355966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-98326f2e-f23a-45ed-aeb3-ccf1a788f1fb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:45.356592 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-98326f2e-f23a-45ed-aeb3-ccf1a788f1fb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:45.366576 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-98326f2e-f23a-45ed-aeb3-ccf1a788f1fb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:45.368986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-98326f2e-f23a-45ed-aeb3-ccf1a788f1fb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:45.370314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-98326f2e-f23a-45ed-aeb3-ccf1a788f1fb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:45.371375 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-98326f2e-f23a-45ed-aeb3-ccf1a788f1fb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:45.511352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d477290f-19bf-4361-ab7b-840ada7689b2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:45.521264 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d477290f-19bf-4361-ab7b-840ada7689b2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.228184 Jul 28 06:37:45.521857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:45 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:45.572838 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-13c6471d-e3c9-48df-8273-a1903741cfcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:45.574092 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-13c6471d-e3c9-48df-8273-a1903741cfcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:45.580964 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13c6471d-e3c9-48df-8273-a1903741cfcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:45.581612 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13c6471d-e3c9-48df-8273-a1903741cfcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:45.583273 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13c6471d-e3c9-48df-8273-a1903741cfcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:45.584166 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13c6471d-e3c9-48df-8273-a1903741cfcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:45.625861 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-98326f2e-f23a-45ed-aeb3-ccf1a788f1fb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:45.641814 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-98326f2e-f23a-45ed-aeb3-ccf1a788f1fb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:45.643501 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-98326f2e-f23a-45ed-aeb3-ccf1a788f1fb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:45.644875 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-98326f2e-f23a-45ed-aeb3-ccf1a788f1fb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.293118 Jul 28 06:37:45.645960 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 33/68] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:45 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:45.676384 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-13c6471d-e3c9-48df-8273-a1903741cfcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:45.689395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-13c6471d-e3c9-48df-8273-a1903741cfcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1292 microversion: 2.1 time: 0.120562 Jul 28 06:37:45.690438 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 36/69] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:45 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1292 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:46.174472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5492f143-7089-481a-9b13-f58defd0403a tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:46.175361 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5492f143-7089-481a-9b13-f58defd0403a tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:46.182941 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5492f143-7089-481a-9b13-f58defd0403a tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:46.183386 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5492f143-7089-481a-9b13-f58defd0403a tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:46.184448 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5492f143-7089-481a-9b13-f58defd0403a tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:46.184887 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5492f143-7089-481a-9b13-f58defd0403a tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:46.337393 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5492f143-7089-481a-9b13-f58defd0403a tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:46.345750 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5492f143-7089-481a-9b13-f58defd0403a tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.176641 Jul 28 06:37:46.347362 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 34/70] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:46 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:46.546672 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a8627a47-48fe-4af2-89e4-49d391a53025 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:46.547370 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a8627a47-48fe-4af2-89e4-49d391a53025 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:46.555942 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a8627a47-48fe-4af2-89e4-49d391a53025 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:46.556688 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a8627a47-48fe-4af2-89e4-49d391a53025 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:46.557710 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a8627a47-48fe-4af2-89e4-49d391a53025 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:46.558342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a8627a47-48fe-4af2-89e4-49d391a53025 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:46.680097 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-23a59f23-cf2f-4f92-8cb2-fccc2900d577 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:46.681522 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-23a59f23-cf2f-4f92-8cb2-fccc2900d577 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:46.690709 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23a59f23-cf2f-4f92-8cb2-fccc2900d577 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:46.692066 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23a59f23-cf2f-4f92-8cb2-fccc2900d577 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:46.693453 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23a59f23-cf2f-4f92-8cb2-fccc2900d577 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:46.694875 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23a59f23-cf2f-4f92-8cb2-fccc2900d577 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:46.794692 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a8627a47-48fe-4af2-89e4-49d391a53025 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:46.810833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a8627a47-48fe-4af2-89e4-49d391a53025 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.267559 Jul 28 06:37:46.813132 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 37/71] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:46 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:46.831287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5803922d-61f3-435f-a8e7-9219263b9497 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:46.835823 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5803922d-61f3-435f-a8e7-9219263b9497 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:46.849425 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5803922d-61f3-435f-a8e7-9219263b9497 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:46.849942 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5803922d-61f3-435f-a8e7-9219263b9497 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:46.850830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5803922d-61f3-435f-a8e7-9219263b9497 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:46.851189 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5803922d-61f3-435f-a8e7-9219263b9497 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:46.931194 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5803922d-61f3-435f-a8e7-9219263b9497 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:46.938534 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5803922d-61f3-435f-a8e7-9219263b9497 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1292 microversion: 2.1 time: 0.124073 Jul 28 06:37:46.939398 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 38/72] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:46 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1292 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:46.962719 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-23a59f23-cf2f-4f92-8cb2-fccc2900d577 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:46.970940 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-23a59f23-cf2f-4f92-8cb2-fccc2900d577 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:46.973317 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-23a59f23-cf2f-4f92-8cb2-fccc2900d577 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:46.974761 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-23a59f23-cf2f-4f92-8cb2-fccc2900d577 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.310442 Jul 28 06:37:46.975507 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 35/73] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:46 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:37:46.988450 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-e026723f-2804-4924-9c9b-ca0f00ec79b0 req-2d2c416c-eabb-49ba-93da-ee9f1b0aa70e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1897c3-cdbe-4796-972b-29758824f972", "tag": "c069b7a6-23c4-4f73-8439-bbaa0bf0be15"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:47.010405 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-e026723f-2804-4924-9c9b-ca0f00ec79b0 req-2d2c416c-eabb-49ba-93da-ee9f1b0aa70e service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:47.010870 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-e026723f-2804-4924-9c9b-ca0f00ec79b0 req-2d2c416c-eabb-49ba-93da-ee9f1b0aa70e service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:47.032946 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-e026723f-2804-4924-9c9b-ca0f00ec79b0 req-2d2c416c-eabb-49ba-93da-ee9f1b0aa70e service nova] Creating event network-changed:c069b7a6-23c4-4f73-8439-bbaa0bf0be15 for instance 6b1897c3-cdbe-4796-972b-29758824f972 on hv-cinder-85060 Jul 28 06:37:47.039322 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-e026723f-2804-4924-9c9b-ca0f00ec79b0 req-2d2c416c-eabb-49ba-93da-ee9f1b0aa70e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054181 Jul 28 06:37:47.040459 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 39/74] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:37:47.368579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0b38c3a6-7b05-4bde-bafb-822c157d1a68 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:47.369414 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0b38c3a6-7b05-4bde-bafb-822c157d1a68 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:47.384013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0b38c3a6-7b05-4bde-bafb-822c157d1a68 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:47.384647 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0b38c3a6-7b05-4bde-bafb-822c157d1a68 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:47.385524 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0b38c3a6-7b05-4bde-bafb-822c157d1a68 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:47.386092 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0b38c3a6-7b05-4bde-bafb-822c157d1a68 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:47.400904 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:47.683041 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0b38c3a6-7b05-4bde-bafb-822c157d1a68 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:47.716777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0b38c3a6-7b05-4bde-bafb-822c157d1a68 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.350468 Jul 28 06:37:47.717639 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 36/75] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:47 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:47.842752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-aeb2b957-7660-46f6-b114-8eb23a45c6ef tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:47.851313 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-aeb2b957-7660-46f6-b114-8eb23a45c6ef tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:47.857697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aeb2b957-7660-46f6-b114-8eb23a45c6ef tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:47.858188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aeb2b957-7660-46f6-b114-8eb23a45c6ef tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:47.858984 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aeb2b957-7660-46f6-b114-8eb23a45c6ef tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:47.872140 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aeb2b957-7660-46f6-b114-8eb23a45c6ef tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:47.961077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ddfe7892-aeec-4bce-8198-f558c08a4811 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:47.963466 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ddfe7892-aeec-4bce-8198-f558c08a4811 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:47.982373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ddfe7892-aeec-4bce-8198-f558c08a4811 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:47.983251 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ddfe7892-aeec-4bce-8198-f558c08a4811 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:47.984792 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ddfe7892-aeec-4bce-8198-f558c08a4811 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:47.985476 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ddfe7892-aeec-4bce-8198-f558c08a4811 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:48.131890 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ddfe7892-aeec-4bce-8198-f558c08a4811 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:48.150812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ddfe7892-aeec-4bce-8198-f558c08a4811 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1292 microversion: 2.1 time: 0.194293 Jul 28 06:37:48.158486 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 37/76] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:47 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1292 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:48.170385 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-133655d5-6faf-4907-a53b-6abe1a734245 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:48.171312 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-133655d5-6faf-4907-a53b-6abe1a734245 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:48.178911 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-133655d5-6faf-4907-a53b-6abe1a734245 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:48.179864 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-133655d5-6faf-4907-a53b-6abe1a734245 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:48.180983 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-133655d5-6faf-4907-a53b-6abe1a734245 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:48.181883 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-133655d5-6faf-4907-a53b-6abe1a734245 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:48.197756 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-aeb2b957-7660-46f6-b114-8eb23a45c6ef tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:48.209826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-aeb2b957-7660-46f6-b114-8eb23a45c6ef tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.378908 Jul 28 06:37:48.210971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 40/77] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:47 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:48.451106 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-133655d5-6faf-4907-a53b-6abe1a734245 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:48.471667 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-133655d5-6faf-4907-a53b-6abe1a734245 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:48.474811 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-133655d5-6faf-4907-a53b-6abe1a734245 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:48.476548 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-133655d5-6faf-4907-a53b-6abe1a734245 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.316773 Jul 28 06:37:48.477937 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 38/78] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:48 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:48.743088 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-09c96e01-b751-4e71-9a59-2bcb885cfb28 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:48.743641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-09c96e01-b751-4e71-9a59-2bcb885cfb28 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:48.760456 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09c96e01-b751-4e71-9a59-2bcb885cfb28 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:48.760854 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09c96e01-b751-4e71-9a59-2bcb885cfb28 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:48.790483 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09c96e01-b751-4e71-9a59-2bcb885cfb28 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:48.791933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09c96e01-b751-4e71-9a59-2bcb885cfb28 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:49.059346 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-09c96e01-b751-4e71-9a59-2bcb885cfb28 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:49.072482 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-09c96e01-b751-4e71-9a59-2bcb885cfb28 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.334309 Jul 28 06:37:49.073677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 41/79] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:48 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:49.174849 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c55c0bea-b889-4e1a-acd9-a959a5cdadad tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:49.177938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c55c0bea-b889-4e1a-acd9-a959a5cdadad tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:49.190706 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c55c0bea-b889-4e1a-acd9-a959a5cdadad tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:49.191913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c55c0bea-b889-4e1a-acd9-a959a5cdadad tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:49.196914 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c55c0bea-b889-4e1a-acd9-a959a5cdadad tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:49.197704 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c55c0bea-b889-4e1a-acd9-a959a5cdadad tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:49.233573 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-724fdf50-a22a-4dba-a97d-88a3cb3af367 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:49.235338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-724fdf50-a22a-4dba-a97d-88a3cb3af367 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:49.258858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-724fdf50-a22a-4dba-a97d-88a3cb3af367 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:49.264420 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-724fdf50-a22a-4dba-a97d-88a3cb3af367 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:49.270249 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-724fdf50-a22a-4dba-a97d-88a3cb3af367 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:49.271949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-724fdf50-a22a-4dba-a97d-88a3cb3af367 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:49.351950 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c55c0bea-b889-4e1a-acd9-a959a5cdadad tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:49.360075 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c55c0bea-b889-4e1a-acd9-a959a5cdadad tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1292 microversion: 2.1 time: 0.189004 Jul 28 06:37:49.360661 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 39/80] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:49 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1292 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:49.389548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=22 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:49.505247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6d9a9904-16c4-42ab-be47-64d1139ac1f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:49.506998 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6d9a9904-16c4-42ab-be47-64d1139ac1f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:49.522430 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d9a9904-16c4-42ab-be47-64d1139ac1f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:49.524216 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d9a9904-16c4-42ab-be47-64d1139ac1f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:49.527204 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d9a9904-16c4-42ab-be47-64d1139ac1f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:49.530633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d9a9904-16c4-42ab-be47-64d1139ac1f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:49.591705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-724fdf50-a22a-4dba-a97d-88a3cb3af367 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:49.603097 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-724fdf50-a22a-4dba-a97d-88a3cb3af367 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.375524 Jul 28 06:37:49.606781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 42/81] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:49 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:50.096307 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4ad36ef6-800c-4348-8ddb-50fffa7f16ce tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:50.097001 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4ad36ef6-800c-4348-8ddb-50fffa7f16ce tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:50.112526 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4ad36ef6-800c-4348-8ddb-50fffa7f16ce tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:50.127379 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4ad36ef6-800c-4348-8ddb-50fffa7f16ce tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:50.134054 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4ad36ef6-800c-4348-8ddb-50fffa7f16ce tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:50.137208 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4ad36ef6-800c-4348-8ddb-50fffa7f16ce tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:50.270941 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6d9a9904-16c4-42ab-be47-64d1139ac1f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:50.285430 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6d9a9904-16c4-42ab-be47-64d1139ac1f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:50.287586 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6d9a9904-16c4-42ab-be47-64d1139ac1f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:50.288931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6d9a9904-16c4-42ab-be47-64d1139ac1f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.789709 Jul 28 06:37:50.293675 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 40/82] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:49 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:50.388797 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cc507a06-e0ca-4814-9041-bd0690f77c93 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:50.391930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cc507a06-e0ca-4814-9041-bd0690f77c93 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:50.402459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc507a06-e0ca-4814-9041-bd0690f77c93 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:50.402918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc507a06-e0ca-4814-9041-bd0690f77c93 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:50.403730 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc507a06-e0ca-4814-9041-bd0690f77c93 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:50.404287 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc507a06-e0ca-4814-9041-bd0690f77c93 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:50.563481 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cc507a06-e0ca-4814-9041-bd0690f77c93 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:50.575447 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cc507a06-e0ca-4814-9041-bd0690f77c93 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1310 microversion: 2.1 time: 0.194817 Jul 28 06:37:50.594882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 41/83] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:50 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1310 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:50.632769 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c76f692e-0bfa-4935-8f56-5f54d7b8eb2f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:50.633831 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c76f692e-0bfa-4935-8f56-5f54d7b8eb2f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:50.646134 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c76f692e-0bfa-4935-8f56-5f54d7b8eb2f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:50.650244 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c76f692e-0bfa-4935-8f56-5f54d7b8eb2f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:50.650244 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c76f692e-0bfa-4935-8f56-5f54d7b8eb2f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:50.650244 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c76f692e-0bfa-4935-8f56-5f54d7b8eb2f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:50.976432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4ad36ef6-800c-4348-8ddb-50fffa7f16ce tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:50.984480 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4ad36ef6-800c-4348-8ddb-50fffa7f16ce tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.892431 Jul 28 06:37:50.990298 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 43/84] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:50 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:51.116225 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c76f692e-0bfa-4935-8f56-5f54d7b8eb2f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:51.132253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c76f692e-0bfa-4935-8f56-5f54d7b8eb2f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.505418 Jul 28 06:37:51.134916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 42/85] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:50 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:51.323811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-98006ee5-5986-4262-9f03-62f66699ac8a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:51.325165 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-98006ee5-5986-4262-9f03-62f66699ac8a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:51.333744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-98006ee5-5986-4262-9f03-62f66699ac8a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:51.334464 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-98006ee5-5986-4262-9f03-62f66699ac8a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:51.338474 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-98006ee5-5986-4262-9f03-62f66699ac8a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:51.339426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-98006ee5-5986-4262-9f03-62f66699ac8a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:51.602501 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1e9d7d50-edec-4045-8141-972eaf66a3a5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:51.603125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1e9d7d50-edec-4045-8141-972eaf66a3a5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:51.614352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1e9d7d50-edec-4045-8141-972eaf66a3a5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:51.614908 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1e9d7d50-edec-4045-8141-972eaf66a3a5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:51.615709 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1e9d7d50-edec-4045-8141-972eaf66a3a5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:51.623626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1e9d7d50-edec-4045-8141-972eaf66a3a5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:51.823678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-98006ee5-5986-4262-9f03-62f66699ac8a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:51.838025 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-98006ee5-5986-4262-9f03-62f66699ac8a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:51.844329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-98006ee5-5986-4262-9f03-62f66699ac8a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:51.850792 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-98006ee5-5986-4262-9f03-62f66699ac8a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.531558 Jul 28 06:37:51.851455 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 44/86] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:51 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:52.014490 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4f25671f-9b15-4c72-8c3c-f634f4f9d072 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:52.015521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4f25671f-9b15-4c72-8c3c-f634f4f9d072 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:52.045498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4f25671f-9b15-4c72-8c3c-f634f4f9d072 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:52.054624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4f25671f-9b15-4c72-8c3c-f634f4f9d072 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:52.055619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4f25671f-9b15-4c72-8c3c-f634f4f9d072 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:52.058457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4f25671f-9b15-4c72-8c3c-f634f4f9d072 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:52.115633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1e9d7d50-edec-4045-8141-972eaf66a3a5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:52.125662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1e9d7d50-edec-4045-8141-972eaf66a3a5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1298 microversion: 2.1 time: 0.527144 Jul 28 06:37:52.157621 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 43/87] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:51 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1298 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:52.157621 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4b850a62-6a9a-4550-90c1-6f845c0917ad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:52.157621 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4b850a62-6a9a-4550-90c1-6f845c0917ad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:52.188911 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4b850a62-6a9a-4550-90c1-6f845c0917ad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:52.189395 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4b850a62-6a9a-4550-90c1-6f845c0917ad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:52.190192 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4b850a62-6a9a-4550-90c1-6f845c0917ad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:52.190634 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4b850a62-6a9a-4550-90c1-6f845c0917ad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:52.399703 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:52.464340 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4f25671f-9b15-4c72-8c3c-f634f4f9d072 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:52.474561 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4f25671f-9b15-4c72-8c3c-f634f4f9d072 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.467355 Jul 28 06:37:52.488317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 45/88] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:52 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:52.490703 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4b850a62-6a9a-4550-90c1-6f845c0917ad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:52.499669 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4b850a62-6a9a-4550-90c1-6f845c0917ad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.346501 Jul 28 06:37:52.500449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 44/89] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:52 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:52.877867 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1e76d6cd-dcd4-49ba-88a3-6b98a5acc755 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:52.879123 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1e76d6cd-dcd4-49ba-88a3-6b98a5acc755 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:52.889205 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e76d6cd-dcd4-49ba-88a3-6b98a5acc755 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:52.890966 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e76d6cd-dcd4-49ba-88a3-6b98a5acc755 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:52.891826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e76d6cd-dcd4-49ba-88a3-6b98a5acc755 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:52.892339 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e76d6cd-dcd4-49ba-88a3-6b98a5acc755 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:53.149559 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6250ee4e-e4be-48b4-885d-3d4d65f0bba2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:53.150180 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6250ee4e-e4be-48b4-885d-3d4d65f0bba2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:53.156419 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6250ee4e-e4be-48b4-885d-3d4d65f0bba2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:53.161986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6250ee4e-e4be-48b4-885d-3d4d65f0bba2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:53.163259 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6250ee4e-e4be-48b4-885d-3d4d65f0bba2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:53.163840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6250ee4e-e4be-48b4-885d-3d4d65f0bba2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:53.167284 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1e76d6cd-dcd4-49ba-88a3-6b98a5acc755 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:53.213172 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1e76d6cd-dcd4-49ba-88a3-6b98a5acc755 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:53.215146 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1e76d6cd-dcd4-49ba-88a3-6b98a5acc755 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:53.224667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1e76d6cd-dcd4-49ba-88a3-6b98a5acc755 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.343050 Jul 28 06:37:53.226315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 46/90] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:52 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:53.346293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6250ee4e-e4be-48b4-885d-3d4d65f0bba2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:53.364622 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6250ee4e-e4be-48b4-885d-3d4d65f0bba2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1298 microversion: 2.1 time: 0.219880 Jul 28 06:37:53.371874 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 45/91] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:53 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1298 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:53.494952 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ca2b4c05-a7c5-4d05-b3d3-e73c790ab98b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:53.495558 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ca2b4c05-a7c5-4d05-b3d3-e73c790ab98b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:53.502572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ca2b4c05-a7c5-4d05-b3d3-e73c790ab98b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:53.503238 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ca2b4c05-a7c5-4d05-b3d3-e73c790ab98b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:53.504740 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ca2b4c05-a7c5-4d05-b3d3-e73c790ab98b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:53.505179 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ca2b4c05-a7c5-4d05-b3d3-e73c790ab98b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:53.524076 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4ccbabf3-143f-46aa-a89d-fb0e5ecb7f66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:53.525559 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4ccbabf3-143f-46aa-a89d-fb0e5ecb7f66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:53.534559 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4ccbabf3-143f-46aa-a89d-fb0e5ecb7f66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:53.536435 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4ccbabf3-143f-46aa-a89d-fb0e5ecb7f66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:53.537526 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4ccbabf3-143f-46aa-a89d-fb0e5ecb7f66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:53.538126 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4ccbabf3-143f-46aa-a89d-fb0e5ecb7f66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:53.677852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ca2b4c05-a7c5-4d05-b3d3-e73c790ab98b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:53.686572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ca2b4c05-a7c5-4d05-b3d3-e73c790ab98b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.194652 Jul 28 06:37:53.692062 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 47/92] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:53 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:53.712933 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4ccbabf3-143f-46aa-a89d-fb0e5ecb7f66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:53.721002 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4ccbabf3-143f-46aa-a89d-fb0e5ecb7f66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.202981 Jul 28 06:37:53.721793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 46/93] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:53 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:54.247697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-90eb4c1b-e4ff-4d5b-b085-eb787e5b5439 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:54.248309 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-90eb4c1b-e4ff-4d5b-b085-eb787e5b5439 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:54.254855 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90eb4c1b-e4ff-4d5b-b085-eb787e5b5439 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:54.255520 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90eb4c1b-e4ff-4d5b-b085-eb787e5b5439 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:54.256527 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90eb4c1b-e4ff-4d5b-b085-eb787e5b5439 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:54.257114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90eb4c1b-e4ff-4d5b-b085-eb787e5b5439 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:54.398283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f4761387-69cb-497c-a0d5-c7ceb5261c9e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:54.399669 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f4761387-69cb-497c-a0d5-c7ceb5261c9e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:54.414139 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4761387-69cb-497c-a0d5-c7ceb5261c9e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:54.414844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4761387-69cb-497c-a0d5-c7ceb5261c9e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:54.415765 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4761387-69cb-497c-a0d5-c7ceb5261c9e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:54.416347 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4761387-69cb-497c-a0d5-c7ceb5261c9e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:54.561134 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f4761387-69cb-497c-a0d5-c7ceb5261c9e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:54.578493 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f4761387-69cb-497c-a0d5-c7ceb5261c9e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1298 microversion: 2.1 time: 0.184465 Jul 28 06:37:54.579102 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 47/94] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:54 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1298 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:54.708844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ff833a9e-1981-4654-83e2-e87a29fa3753 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:54.709524 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ff833a9e-1981-4654-83e2-e87a29fa3753 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:54.717906 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff833a9e-1981-4654-83e2-e87a29fa3753 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:54.718346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff833a9e-1981-4654-83e2-e87a29fa3753 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:54.719114 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff833a9e-1981-4654-83e2-e87a29fa3753 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:54.734002 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff833a9e-1981-4654-83e2-e87a29fa3753 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:54.809122 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-90eb4c1b-e4ff-4d5b-b085-eb787e5b5439 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:54.818222 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-90eb4c1b-e4ff-4d5b-b085-eb787e5b5439 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:54.820085 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-90eb4c1b-e4ff-4d5b-b085-eb787e5b5439 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:54.821317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-90eb4c1b-e4ff-4d5b-b085-eb787e5b5439 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.577454 Jul 28 06:37:54.821850 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 48/95] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:54 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:54.826940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8aadf703-3dc6-4db4-a84a-da699a096a0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:54.827762 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8aadf703-3dc6-4db4-a84a-da699a096a0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:54.837566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8aadf703-3dc6-4db4-a84a-da699a096a0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:54.838469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8aadf703-3dc6-4db4-a84a-da699a096a0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:54.839458 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8aadf703-3dc6-4db4-a84a-da699a096a0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:54.840070 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8aadf703-3dc6-4db4-a84a-da699a096a0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:54.919423 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=4 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:54.996388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8aadf703-3dc6-4db4-a84a-da699a096a0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:55.005931 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8aadf703-3dc6-4db4-a84a-da699a096a0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.182847 Jul 28 06:37:55.006582 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 49/96] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:54 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:55.086694 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ff833a9e-1981-4654-83e2-e87a29fa3753 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:55.113705 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ff833a9e-1981-4654-83e2-e87a29fa3753 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.408630 Jul 28 06:37:55.114312 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 48/97] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:54 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:55.600534 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a86754a5-94dd-411d-9bcc-427a84c2db9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:55.601190 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a86754a5-94dd-411d-9bcc-427a84c2db9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:55.611366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a86754a5-94dd-411d-9bcc-427a84c2db9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:55.611941 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a86754a5-94dd-411d-9bcc-427a84c2db9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:55.612602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a86754a5-94dd-411d-9bcc-427a84c2db9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:55.613284 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a86754a5-94dd-411d-9bcc-427a84c2db9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:55.802285 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a86754a5-94dd-411d-9bcc-427a84c2db9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:55.810028 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a86754a5-94dd-411d-9bcc-427a84c2db9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.213498 Jul 28 06:37:55.810680 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 50/98] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:55 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:55.843978 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a69c84e6-e06a-4993-a47b-83aabad9fcda tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:55.844595 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a69c84e6-e06a-4993-a47b-83aabad9fcda tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:55.851282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a69c84e6-e06a-4993-a47b-83aabad9fcda tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:55.851747 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a69c84e6-e06a-4993-a47b-83aabad9fcda tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:55.852533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a69c84e6-e06a-4993-a47b-83aabad9fcda tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:55.852936 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a69c84e6-e06a-4993-a47b-83aabad9fcda tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:56.027006 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-baf9276a-0e69-4ab5-9b5a-8e7ba0e68d8c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:56.028136 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-baf9276a-0e69-4ab5-9b5a-8e7ba0e68d8c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:56.030339 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a69c84e6-e06a-4993-a47b-83aabad9fcda tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:56.035300 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baf9276a-0e69-4ab5-9b5a-8e7ba0e68d8c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:56.036356 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baf9276a-0e69-4ab5-9b5a-8e7ba0e68d8c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:56.037172 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baf9276a-0e69-4ab5-9b5a-8e7ba0e68d8c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:56.037635 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baf9276a-0e69-4ab5-9b5a-8e7ba0e68d8c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:56.042784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a69c84e6-e06a-4993-a47b-83aabad9fcda tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:56.044378 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a69c84e6-e06a-4993-a47b-83aabad9fcda tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:56.045915 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a69c84e6-e06a-4993-a47b-83aabad9fcda tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.205754 Jul 28 06:37:56.046527 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 49/99] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:55 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:56.069031 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:56.136481 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-85fa629a-ca00-48b1-aa7e-196a1efa6dd9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:56.137403 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-85fa629a-ca00-48b1-aa7e-196a1efa6dd9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:56.143928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-85fa629a-ca00-48b1-aa7e-196a1efa6dd9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:56.144687 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-85fa629a-ca00-48b1-aa7e-196a1efa6dd9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:56.145841 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-85fa629a-ca00-48b1-aa7e-196a1efa6dd9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:56.146438 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-85fa629a-ca00-48b1-aa7e-196a1efa6dd9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:56.235841 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-baf9276a-0e69-4ab5-9b5a-8e7ba0e68d8c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:56.247323 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-baf9276a-0e69-4ab5-9b5a-8e7ba0e68d8c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.224430 Jul 28 06:37:56.247903 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 51/100] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:56 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:56.301257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-85fa629a-ca00-48b1-aa7e-196a1efa6dd9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:56.308780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-85fa629a-ca00-48b1-aa7e-196a1efa6dd9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.176819 Jul 28 06:37:56.309491 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:56 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:56.833121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e7ccdf05-b762-44e2-9a06-e4d7ff60d203 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:56.833761 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e7ccdf05-b762-44e2-9a06-e4d7ff60d203 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:56.839703 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e7ccdf05-b762-44e2-9a06-e4d7ff60d203 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:56.840149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e7ccdf05-b762-44e2-9a06-e4d7ff60d203 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:56.840907 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e7ccdf05-b762-44e2-9a06-e4d7ff60d203 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:56.841365 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e7ccdf05-b762-44e2-9a06-e4d7ff60d203 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:56.982580 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e7ccdf05-b762-44e2-9a06-e4d7ff60d203 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:56.989944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e7ccdf05-b762-44e2-9a06-e4d7ff60d203 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.161824 Jul 28 06:37:56.990511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 52/102] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:56 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:57.078753 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f9a7d440-5e07-4f81-aa4e-74410f1fe52a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:57.079741 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f9a7d440-5e07-4f81-aa4e-74410f1fe52a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:57.085738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f9a7d440-5e07-4f81-aa4e-74410f1fe52a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:57.086178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f9a7d440-5e07-4f81-aa4e-74410f1fe52a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:57.087021 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f9a7d440-5e07-4f81-aa4e-74410f1fe52a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:57.087457 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f9a7d440-5e07-4f81-aa4e-74410f1fe52a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:57.220543 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f9a7d440-5e07-4f81-aa4e-74410f1fe52a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:57.229884 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f9a7d440-5e07-4f81-aa4e-74410f1fe52a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:57.231535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f9a7d440-5e07-4f81-aa4e-74410f1fe52a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:57.232617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f9a7d440-5e07-4f81-aa4e-74410f1fe52a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.158430 Jul 28 06:37:57.233160 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 51/103] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:57 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:37:57.267643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-507d4f7a-0132-4aeb-935e-dc4a901ef438 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:57.268247 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-507d4f7a-0132-4aeb-935e-dc4a901ef438 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:57.275056 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-507d4f7a-0132-4aeb-935e-dc4a901ef438 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:57.275498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-507d4f7a-0132-4aeb-935e-dc4a901ef438 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:57.276253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-507d4f7a-0132-4aeb-935e-dc4a901ef438 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:57.276682 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-507d4f7a-0132-4aeb-935e-dc4a901ef438 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:57.330505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bbbf0b41-22be-4e00-8401-f3a7314a4713 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:57.331008 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bbbf0b41-22be-4e00-8401-f3a7314a4713 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:57.338347 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bbbf0b41-22be-4e00-8401-f3a7314a4713 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:57.339003 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bbbf0b41-22be-4e00-8401-f3a7314a4713 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:57.339852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bbbf0b41-22be-4e00-8401-f3a7314a4713 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:57.340272 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bbbf0b41-22be-4e00-8401-f3a7314a4713 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:57.416020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-507d4f7a-0132-4aeb-935e-dc4a901ef438 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:57.423694 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-507d4f7a-0132-4aeb-935e-dc4a901ef438 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.159756 Jul 28 06:37:57.424555 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 53/104] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:57 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:57.507857 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bbbf0b41-22be-4e00-8401-f3a7314a4713 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:57.511328 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:57.516102 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bbbf0b41-22be-4e00-8401-f3a7314a4713 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.189660 Jul 28 06:37:57.516665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 52/105] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:57 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:58.012380 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b058e2ed-605f-45f2-94ca-765ae2996928 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:58.012997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b058e2ed-605f-45f2-94ca-765ae2996928 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:58.019960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b058e2ed-605f-45f2-94ca-765ae2996928 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:58.020423 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b058e2ed-605f-45f2-94ca-765ae2996928 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:58.021193 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b058e2ed-605f-45f2-94ca-765ae2996928 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:58.021781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b058e2ed-605f-45f2-94ca-765ae2996928 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:58.169704 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b058e2ed-605f-45f2-94ca-765ae2996928 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:58.177382 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b058e2ed-605f-45f2-94ca-765ae2996928 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.169146 Jul 28 06:37:58.178473 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 54/106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:58 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:58.255673 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a04db1ce-43be-4853-8a89-def4534390f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:58.257948 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a04db1ce-43be-4853-8a89-def4534390f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:58.264910 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a04db1ce-43be-4853-8a89-def4534390f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:58.265742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a04db1ce-43be-4853-8a89-def4534390f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:58.267445 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a04db1ce-43be-4853-8a89-def4534390f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:58.268356 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a04db1ce-43be-4853-8a89-def4534390f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:58.445486 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8539faca-2e85-465d-b456-b0a9c52ee83b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:58.446250 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8539faca-2e85-465d-b456-b0a9c52ee83b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:58.453846 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8539faca-2e85-465d-b456-b0a9c52ee83b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:58.454597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8539faca-2e85-465d-b456-b0a9c52ee83b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:58.455436 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8539faca-2e85-465d-b456-b0a9c52ee83b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:58.455990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8539faca-2e85-465d-b456-b0a9c52ee83b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:58.567865 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a04db1ce-43be-4853-8a89-def4534390f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:58.580847 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a04db1ce-43be-4853-8a89-def4534390f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:58.585095 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a04db1ce-43be-4853-8a89-def4534390f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:58.586107 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a04db1ce-43be-4853-8a89-def4534390f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.335081 Jul 28 06:37:58.594158 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 53/107] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:58 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:37:58.599493 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0b6475e9-45bc-467f-aa43-32c6412c503b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:58.600110 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0b6475e9-45bc-467f-aa43-32c6412c503b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:58.614924 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0b6475e9-45bc-467f-aa43-32c6412c503b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:58.615693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0b6475e9-45bc-467f-aa43-32c6412c503b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:58.617967 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0b6475e9-45bc-467f-aa43-32c6412c503b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:58.618644 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0b6475e9-45bc-467f-aa43-32c6412c503b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:58.629956 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8539faca-2e85-465d-b456-b0a9c52ee83b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:58.641114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8539faca-2e85-465d-b456-b0a9c52ee83b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.200792 Jul 28 06:37:58.642192 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 55/108] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:58 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:58.887768 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0b6475e9-45bc-467f-aa43-32c6412c503b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:58.902023 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0b6475e9-45bc-467f-aa43-32c6412c503b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.303729 Jul 28 06:37:58.904020 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 54/109] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:58 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:59.198761 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-953d901a-07a3-4278-8ca3-6e8b00a70e12 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:59.199379 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-953d901a-07a3-4278-8ca3-6e8b00a70e12 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:59.209880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-953d901a-07a3-4278-8ca3-6e8b00a70e12 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:59.210327 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-953d901a-07a3-4278-8ca3-6e8b00a70e12 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:59.211098 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-953d901a-07a3-4278-8ca3-6e8b00a70e12 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:59.211527 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-953d901a-07a3-4278-8ca3-6e8b00a70e12 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:59.244944 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-d6a9ec2c-3b74-4c18-ae2c-630940b7bd73 req-0c9e588b-547d-4205-9436-c493e7d5b088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3", "tag": "b1d18864-af4e-41d6-b3f8-a68f95159ee7"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:59.270942 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-d6a9ec2c-3b74-4c18-ae2c-630940b7bd73 req-0c9e588b-547d-4205-9436-c493e7d5b088 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:59.272503 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-d6a9ec2c-3b74-4c18-ae2c-630940b7bd73 req-0c9e588b-547d-4205-9436-c493e7d5b088 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:59.306154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-d6a9ec2c-3b74-4c18-ae2c-630940b7bd73 req-0c9e588b-547d-4205-9436-c493e7d5b088 service nova] Creating event network-changed:b1d18864-af4e-41d6-b3f8-a68f95159ee7 for instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 on hv-cinder-85060 Jul 28 06:37:59.312231 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-d6a9ec2c-3b74-4c18-ae2c-630940b7bd73 req-0c9e588b-547d-4205-9436-c493e7d5b088 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070993 Jul 28 06:37:59.314437 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 55/110] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:37:59.413843 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-953d901a-07a3-4278-8ca3-6e8b00a70e12 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:59.422527 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-953d901a-07a3-4278-8ca3-6e8b00a70e12 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.227476 Jul 28 06:37:59.423641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 56/111] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:59 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:59.608388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c8e00613-3a05-4dc9-bb0b-b0b6dbb6a833 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:59.608992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c8e00613-3a05-4dc9-bb0b-b0b6dbb6a833 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:59.615807 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8e00613-3a05-4dc9-bb0b-b0b6dbb6a833 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:59.616251 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8e00613-3a05-4dc9-bb0b-b0b6dbb6a833 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:59.617004 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8e00613-3a05-4dc9-bb0b-b0b6dbb6a833 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:59.617457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8e00613-3a05-4dc9-bb0b-b0b6dbb6a833 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:59.636748 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-f94d2456-8301-4702-b1c6-9bc20a6fda44 req-85473275-ebe8-4b98-bff2-c2bd843826e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759d9d29-e67f-49e4-986a-5d71340fd0c3", "name": "network-vif-plugged", "status": "completed", "tag": "1af3bbc2-bb75-4b78-b8d2-211da789e581"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:59.647407 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-f94d2456-8301-4702-b1c6-9bc20a6fda44 req-85473275-ebe8-4b98-bff2-c2bd843826e3 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:59.647992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-f94d2456-8301-4702-b1c6-9bc20a6fda44 req-85473275-ebe8-4b98-bff2-c2bd843826e3 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:59.663072 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-f94d2456-8301-4702-b1c6-9bc20a6fda44 req-85473275-ebe8-4b98-bff2-c2bd843826e3 service nova] Creating event network-vif-plugged:1af3bbc2-bb75-4b78-b8d2-211da789e581 for instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 on hv-cinder-85060 Jul 28 06:37:59.668677 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-f94d2456-8301-4702-b1c6-9bc20a6fda44 req-85473275-ebe8-4b98-bff2-c2bd843826e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098905 Jul 28 06:37:59.669415 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 56/112] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:37:59.676916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bee5d04a-c185-4997-8b8d-d0878629d635 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:59.677782 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bee5d04a-c185-4997-8b8d-d0878629d635 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:59.684445 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bee5d04a-c185-4997-8b8d-d0878629d635 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:59.684907 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bee5d04a-c185-4997-8b8d-d0878629d635 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:59.685708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bee5d04a-c185-4997-8b8d-d0878629d635 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:59.686146 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bee5d04a-c185-4997-8b8d-d0878629d635 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:59.762675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c8e00613-3a05-4dc9-bb0b-b0b6dbb6a833 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:59.770914 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c8e00613-3a05-4dc9-bb0b-b0b6dbb6a833 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:59.772430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c8e00613-3a05-4dc9-bb0b-b0b6dbb6a833 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:59.773563 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c8e00613-3a05-4dc9-bb0b-b0b6dbb6a833 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.168961 Jul 28 06:37:59.774114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 57/113] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:37:59 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:37:59.833271 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bee5d04a-c185-4997-8b8d-d0878629d635 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:59.840858 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bee5d04a-c185-4997-8b8d-d0878629d635 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.170254 Jul 28 06:37:59.841596 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 57/114] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:59 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:59.924320 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6c6b8594-507a-42bf-b99f-a82ac1e5a855 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:59.924894 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6c6b8594-507a-42bf-b99f-a82ac1e5a855 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:59.931363 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c6b8594-507a-42bf-b99f-a82ac1e5a855 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:59.931813 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c6b8594-507a-42bf-b99f-a82ac1e5a855 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:59.932604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c6b8594-507a-42bf-b99f-a82ac1e5a855 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:59.933043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c6b8594-507a-42bf-b99f-a82ac1e5a855 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:00.087422 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6c6b8594-507a-42bf-b99f-a82ac1e5a855 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:00.095322 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6c6b8594-507a-42bf-b99f-a82ac1e5a855 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.175112 Jul 28 06:38:00.106766 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 58/115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:59 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:00.444478 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-359a4829-65cd-41b3-8a14-6c4d3d333ea3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:00.445025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-359a4829-65cd-41b3-8a14-6c4d3d333ea3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:00.451395 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-359a4829-65cd-41b3-8a14-6c4d3d333ea3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:00.451851 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-359a4829-65cd-41b3-8a14-6c4d3d333ea3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:00.452617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-359a4829-65cd-41b3-8a14-6c4d3d333ea3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:00.453058 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-359a4829-65cd-41b3-8a14-6c4d3d333ea3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:00.580970 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-359a4829-65cd-41b3-8a14-6c4d3d333ea3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:00.589219 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-359a4829-65cd-41b3-8a14-6c4d3d333ea3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.149011 Jul 28 06:38:00.589806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 58/116] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:00 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:00.795980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d35914d6-d781-45a2-9834-e1509da6d359 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:00.796594 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d35914d6-d781-45a2-9834-e1509da6d359 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:00.802783 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d35914d6-d781-45a2-9834-e1509da6d359 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:00.803234 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d35914d6-d781-45a2-9834-e1509da6d359 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:00.803996 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d35914d6-d781-45a2-9834-e1509da6d359 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:00.804430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d35914d6-d781-45a2-9834-e1509da6d359 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:00.862596 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b3846121-e2eb-478b-8bd7-fae165918bd6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:00.863789 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b3846121-e2eb-478b-8bd7-fae165918bd6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:00.869773 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b3846121-e2eb-478b-8bd7-fae165918bd6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:00.870223 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b3846121-e2eb-478b-8bd7-fae165918bd6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:00.870989 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b3846121-e2eb-478b-8bd7-fae165918bd6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:00.871425 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b3846121-e2eb-478b-8bd7-fae165918bd6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:00.933884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d35914d6-d781-45a2-9834-e1509da6d359 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:00.942975 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d35914d6-d781-45a2-9834-e1509da6d359 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:00.944782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d35914d6-d781-45a2-9834-e1509da6d359 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:00.945962 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d35914d6-d781-45a2-9834-e1509da6d359 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.153869 Jul 28 06:38:00.946520 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 59/117] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:00 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:38:01.009428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b3846121-e2eb-478b-8bd7-fae165918bd6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:01.016855 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b3846121-e2eb-478b-8bd7-fae165918bd6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.158145 Jul 28 06:38:01.017430 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 59/118] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:00 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:01.117338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-cf0b7479-ad29-4886-95c8-9f53085a7c73 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:01.117876 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-cf0b7479-ad29-4886-95c8-9f53085a7c73 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:01.123840 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf0b7479-ad29-4886-95c8-9f53085a7c73 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:01.124286 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf0b7479-ad29-4886-95c8-9f53085a7c73 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:01.125139 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf0b7479-ad29-4886-95c8-9f53085a7c73 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:01.125610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf0b7479-ad29-4886-95c8-9f53085a7c73 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:01.262388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-cf0b7479-ad29-4886-95c8-9f53085a7c73 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:01.269954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-cf0b7479-ad29-4886-95c8-9f53085a7c73 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.157348 Jul 28 06:38:01.270508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 60/119] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:01 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:01.610034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ee8174e7-ac10-4231-840a-0ab996488369 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:01.610626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ee8174e7-ac10-4231-840a-0ab996488369 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:01.617128 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ee8174e7-ac10-4231-840a-0ab996488369 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:01.617595 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ee8174e7-ac10-4231-840a-0ab996488369 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:01.618345 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ee8174e7-ac10-4231-840a-0ab996488369 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:01.618772 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ee8174e7-ac10-4231-840a-0ab996488369 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:01.749101 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ee8174e7-ac10-4231-840a-0ab996488369 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:01.756564 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ee8174e7-ac10-4231-840a-0ab996488369 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.150358 Jul 28 06:38:01.757129 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 60/120] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:01 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:01.968158 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5370d2d3-f907-4656-88da-47dc17533f45 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:01.968747 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5370d2d3-f907-4656-88da-47dc17533f45 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:01.975560 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5370d2d3-f907-4656-88da-47dc17533f45 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:01.976008 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5370d2d3-f907-4656-88da-47dc17533f45 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:01.976771 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5370d2d3-f907-4656-88da-47dc17533f45 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:01.977205 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5370d2d3-f907-4656-88da-47dc17533f45 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:02.038524 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-17a3bf0e-0e8c-46d7-9c6e-baaa8df7a37a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:02.039235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-17a3bf0e-0e8c-46d7-9c6e-baaa8df7a37a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:02.045429 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-17a3bf0e-0e8c-46d7-9c6e-baaa8df7a37a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:02.045965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-17a3bf0e-0e8c-46d7-9c6e-baaa8df7a37a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:02.046815 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-17a3bf0e-0e8c-46d7-9c6e-baaa8df7a37a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:02.047357 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-17a3bf0e-0e8c-46d7-9c6e-baaa8df7a37a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:02.109082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5370d2d3-f907-4656-88da-47dc17533f45 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:02.117315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5370d2d3-f907-4656-88da-47dc17533f45 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:02.118815 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5370d2d3-f907-4656-88da-47dc17533f45 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:02.119918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5370d2d3-f907-4656-88da-47dc17533f45 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.155833 Jul 28 06:38:02.120462 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 61/121] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:01 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:38:02.178506 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-17a3bf0e-0e8c-46d7-9c6e-baaa8df7a37a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:02.185836 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-17a3bf0e-0e8c-46d7-9c6e-baaa8df7a37a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.152336 Jul 28 06:38:02.186405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 61/122] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:02 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:02.291488 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2d9cf54c-d555-4c8a-972a-6ab92f5e44e9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:02.292107 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2d9cf54c-d555-4c8a-972a-6ab92f5e44e9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:02.298403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d9cf54c-d555-4c8a-972a-6ab92f5e44e9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:02.298859 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d9cf54c-d555-4c8a-972a-6ab92f5e44e9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:02.299623 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d9cf54c-d555-4c8a-972a-6ab92f5e44e9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:02.300111 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d9cf54c-d555-4c8a-972a-6ab92f5e44e9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:02.432706 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d9cf54c-d555-4c8a-972a-6ab92f5e44e9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:02.443069 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2d9cf54c-d555-4c8a-972a-6ab92f5e44e9 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.155438 Jul 28 06:38:02.443741 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 62/123] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:02 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:02.777770 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b652a890-5873-4fc8-92f8-cac750401c09 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:02.778380 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b652a890-5873-4fc8-92f8-cac750401c09 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:02.784971 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b652a890-5873-4fc8-92f8-cac750401c09 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:02.786030 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b652a890-5873-4fc8-92f8-cac750401c09 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:02.786796 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b652a890-5873-4fc8-92f8-cac750401c09 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:02.787232 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b652a890-5873-4fc8-92f8-cac750401c09 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:02.834664 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-30b0734c-b0e8-44ce-9dcd-aee342593fc0 req-836a4db0-a23e-41b2-a4e6-8685b6fbaeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1897c3-cdbe-4796-972b-29758824f972", "name": "network-vif-plugged", "status": "completed", "tag": "c069b7a6-23c4-4f73-8439-bbaa0bf0be15"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:02.846345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-30b0734c-b0e8-44ce-9dcd-aee342593fc0 req-836a4db0-a23e-41b2-a4e6-8685b6fbaeda service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:02.846774 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-30b0734c-b0e8-44ce-9dcd-aee342593fc0 req-836a4db0-a23e-41b2-a4e6-8685b6fbaeda service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:02.861085 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-30b0734c-b0e8-44ce-9dcd-aee342593fc0 req-836a4db0-a23e-41b2-a4e6-8685b6fbaeda service nova] Creating event network-vif-plugged:c069b7a6-23c4-4f73-8439-bbaa0bf0be15 for instance 6b1897c3-cdbe-4796-972b-29758824f972 on hv-cinder-85060 Jul 28 06:38:02.867570 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-30b0734c-b0e8-44ce-9dcd-aee342593fc0 req-836a4db0-a23e-41b2-a4e6-8685b6fbaeda service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037863 Jul 28 06:38:02.868318 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 63/124] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:38:02.927099 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b652a890-5873-4fc8-92f8-cac750401c09 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:02.935663 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b652a890-5873-4fc8-92f8-cac750401c09 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.161716 Jul 28 06:38:02.936443 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 62/125] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:02 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:03.144424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c6e41e3b-cc32-4575-8b21-9d1ebf8414e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:03.145679 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c6e41e3b-cc32-4575-8b21-9d1ebf8414e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:03.152238 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6e41e3b-cc32-4575-8b21-9d1ebf8414e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:03.152768 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6e41e3b-cc32-4575-8b21-9d1ebf8414e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:03.153678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6e41e3b-cc32-4575-8b21-9d1ebf8414e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:03.154244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6e41e3b-cc32-4575-8b21-9d1ebf8414e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:03.206932 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-27cd4bf5-9153-4c18-ace7-ae11f8c5f8c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:03.209940 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-27cd4bf5-9153-4c18-ace7-ae11f8c5f8c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:03.226654 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-27cd4bf5-9153-4c18-ace7-ae11f8c5f8c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:03.228119 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-27cd4bf5-9153-4c18-ace7-ae11f8c5f8c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:03.237958 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-27cd4bf5-9153-4c18-ace7-ae11f8c5f8c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:03.238688 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-27cd4bf5-9153-4c18-ace7-ae11f8c5f8c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:03.364420 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c6e41e3b-cc32-4575-8b21-9d1ebf8414e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:03.377145 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c6e41e3b-cc32-4575-8b21-9d1ebf8414e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:03.379596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c6e41e3b-cc32-4575-8b21-9d1ebf8414e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:03.380733 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c6e41e3b-cc32-4575-8b21-9d1ebf8414e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.241335 Jul 28 06:38:03.382352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 64/126] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:03 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:38:03.471410 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d2a83cde-dad2-4704-9116-da780882cd1f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:03.473102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d2a83cde-dad2-4704-9116-da780882cd1f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:03.483178 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2a83cde-dad2-4704-9116-da780882cd1f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:03.483941 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2a83cde-dad2-4704-9116-da780882cd1f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:03.485092 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2a83cde-dad2-4704-9116-da780882cd1f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:03.485818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2a83cde-dad2-4704-9116-da780882cd1f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:03.512607 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-27cd4bf5-9153-4c18-ace7-ae11f8c5f8c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:03.539230 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-27cd4bf5-9153-4c18-ace7-ae11f8c5f8c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.336633 Jul 28 06:38:03.540344 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 63/127] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:03 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:03.647407 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d2a83cde-dad2-4704-9116-da780882cd1f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:03.657550 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d2a83cde-dad2-4704-9116-da780882cd1f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.190382 Jul 28 06:38:03.657949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 65/128] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:03 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:03.958990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f619c582-8703-4590-a1f7-e8640b58c6ac tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:03.960197 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f619c582-8703-4590-a1f7-e8640b58c6ac tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:03.979300 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f619c582-8703-4590-a1f7-e8640b58c6ac tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:03.980013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f619c582-8703-4590-a1f7-e8640b58c6ac tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:03.984371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f619c582-8703-4590-a1f7-e8640b58c6ac tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:03.986452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f619c582-8703-4590-a1f7-e8640b58c6ac tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:04.213324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f619c582-8703-4590-a1f7-e8640b58c6ac tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:04.220783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f619c582-8703-4590-a1f7-e8640b58c6ac tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.267421 Jul 28 06:38:04.221377 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 64/129] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:03 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:04.409405 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2148b942-c179-4efd-9d4a-5521f78c03a7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:04.410414 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2148b942-c179-4efd-9d4a-5521f78c03a7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:04.416970 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2148b942-c179-4efd-9d4a-5521f78c03a7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:04.417406 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2148b942-c179-4efd-9d4a-5521f78c03a7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:04.418306 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2148b942-c179-4efd-9d4a-5521f78c03a7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:04.418834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2148b942-c179-4efd-9d4a-5521f78c03a7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:04.563405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-52b4caa4-1009-490f-9113-31187dc11a0d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:04.564110 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-52b4caa4-1009-490f-9113-31187dc11a0d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:04.572427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-52b4caa4-1009-490f-9113-31187dc11a0d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:04.573254 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-52b4caa4-1009-490f-9113-31187dc11a0d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:04.574368 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-52b4caa4-1009-490f-9113-31187dc11a0d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:04.575005 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-52b4caa4-1009-490f-9113-31187dc11a0d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:04.582421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2148b942-c179-4efd-9d4a-5521f78c03a7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:04.591567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2148b942-c179-4efd-9d4a-5521f78c03a7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:04.593274 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2148b942-c179-4efd-9d4a-5521f78c03a7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:04.594522 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2148b942-c179-4efd-9d4a-5521f78c03a7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.189110 Jul 28 06:38:04.595092 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 66/130] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:04 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:38:04.683432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-de214ebd-c260-44ea-9561-67b51159d174 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:04.684041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-de214ebd-c260-44ea-9561-67b51159d174 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:04.694584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-de214ebd-c260-44ea-9561-67b51159d174 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:04.695464 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-de214ebd-c260-44ea-9561-67b51159d174 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:04.696681 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-de214ebd-c260-44ea-9561-67b51159d174 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:04.697353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-de214ebd-c260-44ea-9561-67b51159d174 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:04.779000 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-52b4caa4-1009-490f-9113-31187dc11a0d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:04.789692 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-52b4caa4-1009-490f-9113-31187dc11a0d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.231197 Jul 28 06:38:04.790520 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 65/131] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:04 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:04.880634 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-de214ebd-c260-44ea-9561-67b51159d174 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:04.890873 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-de214ebd-c260-44ea-9561-67b51159d174 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.211256 Jul 28 06:38:04.893243 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 67/132] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:04 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:05.247717 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-56d3fbc9-8ff0-4929-bd1e-97b271439511 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:05.248391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-56d3fbc9-8ff0-4929-bd1e-97b271439511 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:05.261025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56d3fbc9-8ff0-4929-bd1e-97b271439511 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:05.261578 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56d3fbc9-8ff0-4929-bd1e-97b271439511 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:05.262789 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56d3fbc9-8ff0-4929-bd1e-97b271439511 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:05.263445 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56d3fbc9-8ff0-4929-bd1e-97b271439511 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:05.507116 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-56d3fbc9-8ff0-4929-bd1e-97b271439511 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:05.515365 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-56d3fbc9-8ff0-4929-bd1e-97b271439511 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.272337 Jul 28 06:38:05.516118 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 66/133] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:05 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:05.622086 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ad19e2d0-c6b7-4b81-b59e-7bf0996ce417 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:05.623549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ad19e2d0-c6b7-4b81-b59e-7bf0996ce417 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:05.634715 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ad19e2d0-c6b7-4b81-b59e-7bf0996ce417 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:05.635554 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ad19e2d0-c6b7-4b81-b59e-7bf0996ce417 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:05.636486 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ad19e2d0-c6b7-4b81-b59e-7bf0996ce417 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:05.637346 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ad19e2d0-c6b7-4b81-b59e-7bf0996ce417 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:05.802602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ad19e2d0-c6b7-4b81-b59e-7bf0996ce417 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:05.806203 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:05.812276 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bf5bc2c8-3425-4dd2-b09c-6250d2462081 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:05.812894 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bf5bc2c8-3425-4dd2-b09c-6250d2462081 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:05.814749 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ad19e2d0-c6b7-4b81-b59e-7bf0996ce417 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:05.817107 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ad19e2d0-c6b7-4b81-b59e-7bf0996ce417 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:05.818574 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ad19e2d0-c6b7-4b81-b59e-7bf0996ce417 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.204103 Jul 28 06:38:05.822792 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf5bc2c8-3425-4dd2-b09c-6250d2462081 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:05.823413 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf5bc2c8-3425-4dd2-b09c-6250d2462081 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:05.824627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf5bc2c8-3425-4dd2-b09c-6250d2462081 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:05.825288 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf5bc2c8-3425-4dd2-b09c-6250d2462081 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:05.835329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 68/134] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:05 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:38:05.914863 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-aecde695-8a5a-4114-8791-5c40271e07e7 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:05.915768 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-aecde695-8a5a-4114-8791-5c40271e07e7 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:05.922253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aecde695-8a5a-4114-8791-5c40271e07e7 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:05.923010 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aecde695-8a5a-4114-8791-5c40271e07e7 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:05.924027 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aecde695-8a5a-4114-8791-5c40271e07e7 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:05.924561 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aecde695-8a5a-4114-8791-5c40271e07e7 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:06.066139 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bf5bc2c8-3425-4dd2-b09c-6250d2462081 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:06.081786 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bf5bc2c8-3425-4dd2-b09c-6250d2462081 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.272743 Jul 28 06:38:06.082756 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 67/135] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:05 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:06.104554 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-aecde695-8a5a-4114-8791-5c40271e07e7 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:06.113919 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-aecde695-8a5a-4114-8791-5c40271e07e7 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.202793 Jul 28 06:38:06.114673 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 69/136] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:05 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:06.543960 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6e6fff1e-21e0-4b98-a690-4ca5c723a65c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:06.544582 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6e6fff1e-21e0-4b98-a690-4ca5c723a65c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:06.551744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6e6fff1e-21e0-4b98-a690-4ca5c723a65c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:06.552403 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6e6fff1e-21e0-4b98-a690-4ca5c723a65c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:06.553367 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6e6fff1e-21e0-4b98-a690-4ca5c723a65c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:06.555256 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6e6fff1e-21e0-4b98-a690-4ca5c723a65c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:06.750663 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6e6fff1e-21e0-4b98-a690-4ca5c723a65c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:06.772802 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6e6fff1e-21e0-4b98-a690-4ca5c723a65c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.233836 Jul 28 06:38:06.778100 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 68/137] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:06 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:06.845099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9c9118fd-7ff1-4b2e-b95c-af22e04997bc tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:06.846789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9c9118fd-7ff1-4b2e-b95c-af22e04997bc tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:06.857925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9c9118fd-7ff1-4b2e-b95c-af22e04997bc tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:06.858751 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9c9118fd-7ff1-4b2e-b95c-af22e04997bc tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:06.859592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9c9118fd-7ff1-4b2e-b95c-af22e04997bc tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:06.860020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9c9118fd-7ff1-4b2e-b95c-af22e04997bc tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:07.034168 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9c9118fd-7ff1-4b2e-b95c-af22e04997bc tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:07.049722 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9c9118fd-7ff1-4b2e-b95c-af22e04997bc tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:07.051715 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9c9118fd-7ff1-4b2e-b95c-af22e04997bc tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:07.052852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9c9118fd-7ff1-4b2e-b95c-af22e04997bc tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.214252 Jul 28 06:38:07.066868 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 70/138] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:06 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:38:07.103833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6af59145-aeb5-4185-9b4b-c718fc1003b8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:07.104433 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6af59145-aeb5-4185-9b4b-c718fc1003b8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:07.111226 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6af59145-aeb5-4185-9b4b-c718fc1003b8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:07.111676 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6af59145-aeb5-4185-9b4b-c718fc1003b8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:07.112890 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6af59145-aeb5-4185-9b4b-c718fc1003b8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:07.113428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6af59145-aeb5-4185-9b4b-c718fc1003b8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:07.134837 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9f52fc2b-7686-43b6-b0d5-19e5549072fd tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:07.135683 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9f52fc2b-7686-43b6-b0d5-19e5549072fd tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:07.144957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9f52fc2b-7686-43b6-b0d5-19e5549072fd tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:07.145664 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9f52fc2b-7686-43b6-b0d5-19e5549072fd tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:07.146466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9f52fc2b-7686-43b6-b0d5-19e5549072fd tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:07.146922 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9f52fc2b-7686-43b6-b0d5-19e5549072fd tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:07.310148 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9f52fc2b-7686-43b6-b0d5-19e5549072fd tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:07.322664 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9f52fc2b-7686-43b6-b0d5-19e5549072fd tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1314 microversion: 2.1 time: 0.191452 Jul 28 06:38:07.323235 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:07 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:07.344992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6af59145-aeb5-4185-9b4b-c718fc1003b8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:07.354761 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6af59145-aeb5-4185-9b4b-c718fc1003b8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.254995 Jul 28 06:38:07.355862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 69/140] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:07 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:07.795083 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2d136bce-8523-4a6a-b077-779ea6c8cd03 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:07.795697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2d136bce-8523-4a6a-b077-779ea6c8cd03 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:07.807813 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d136bce-8523-4a6a-b077-779ea6c8cd03 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:07.811345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d136bce-8523-4a6a-b077-779ea6c8cd03 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:07.812405 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d136bce-8523-4a6a-b077-779ea6c8cd03 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:07.812883 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d136bce-8523-4a6a-b077-779ea6c8cd03 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.075061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d136bce-8523-4a6a-b077-779ea6c8cd03 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:08.089808 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2d136bce-8523-4a6a-b077-779ea6c8cd03 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.299484 Jul 28 06:38:08.091317 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b0382b37-7c89-44a5-876a-b7538bfe773c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:08.091749 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 72/141] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:07 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:08.092564 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b0382b37-7c89-44a5-876a-b7538bfe773c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:08.100326 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0382b37-7c89-44a5-876a-b7538bfe773c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.100765 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0382b37-7c89-44a5-876a-b7538bfe773c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.101579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0382b37-7c89-44a5-876a-b7538bfe773c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.102013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0382b37-7c89-44a5-876a-b7538bfe773c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.181575 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-a05a2385-4e03-4a31-a290-0926645b3ede req-2f37ee08-bc29-481c-ab60-58f6d19ff689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd097e6-598d-42a1-a3ad-5d8716bcb7fc", "name": "network-vif-plugged", "status": "completed", "tag": "7d4c8835-d4d0-44cd-b343-088c09fffb3a"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:08.211992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-a05a2385-4e03-4a31-a290-0926645b3ede req-2f37ee08-bc29-481c-ab60-58f6d19ff689 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.213603 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-a05a2385-4e03-4a31-a290-0926645b3ede req-2f37ee08-bc29-481c-ab60-58f6d19ff689 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.241940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-a05a2385-4e03-4a31-a290-0926645b3ede req-2f37ee08-bc29-481c-ab60-58f6d19ff689 service nova] Creating event network-vif-plugged:7d4c8835-d4d0-44cd-b343-088c09fffb3a for instance 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc on hv-cinder-85060 Jul 28 06:38:08.252523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-a05a2385-4e03-4a31-a290-0926645b3ede req-2f37ee08-bc29-481c-ab60-58f6d19ff689 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076765 Jul 28 06:38:08.255650 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 73/142] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:38:08.352718 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-709c53f9-31ac-442a-808f-56cce690e330 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:08.354489 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-709c53f9-31ac-442a-808f-56cce690e330 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:08.380869 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-709c53f9-31ac-442a-808f-56cce690e330 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.381536 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-709c53f9-31ac-442a-808f-56cce690e330 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.386227 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-709c53f9-31ac-442a-808f-56cce690e330 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.386925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-709c53f9-31ac-442a-808f-56cce690e330 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.581611 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-709c53f9-31ac-442a-808f-56cce690e330 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:08.591643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-709c53f9-31ac-442a-808f-56cce690e330 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1501 microversion: 2.1 time: 0.246539 Jul 28 06:38:08.592220 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 74/143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:08 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1501 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:08.602618 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-05849f7a-2d04-455a-a1b2-bff6b21bcf38 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:08.606039 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-05849f7a-2d04-455a-a1b2-bff6b21bcf38 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:08.618150 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-05849f7a-2d04-455a-a1b2-bff6b21bcf38 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.618605 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-05849f7a-2d04-455a-a1b2-bff6b21bcf38 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.619383 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-05849f7a-2d04-455a-a1b2-bff6b21bcf38 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.619821 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-05849f7a-2d04-455a-a1b2-bff6b21bcf38 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.792061 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b0382b37-7c89-44a5-876a-b7538bfe773c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:08.799181 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:08.802276 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b0382b37-7c89-44a5-876a-b7538bfe773c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:08.821555 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b0382b37-7c89-44a5-876a-b7538bfe773c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:08.822726 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b0382b37-7c89-44a5-876a-b7538bfe773c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.748950 Jul 28 06:38:08.823666 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 70/144] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:08 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:38:08.884747 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-05849f7a-2d04-455a-a1b2-bff6b21bcf38 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:08.893600 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-05849f7a-2d04-455a-a1b2-bff6b21bcf38 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.299421 Jul 28 06:38:08.894192 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 75/145] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:08 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:09.116410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1627b733-fa91-4f92-ba99-2ddd03666810 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:09.117285 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1627b733-fa91-4f92-ba99-2ddd03666810 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:09.124081 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1627b733-fa91-4f92-ba99-2ddd03666810 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:09.124647 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1627b733-fa91-4f92-ba99-2ddd03666810 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:09.125662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1627b733-fa91-4f92-ba99-2ddd03666810 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:09.126193 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1627b733-fa91-4f92-ba99-2ddd03666810 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:09.285681 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1627b733-fa91-4f92-ba99-2ddd03666810 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:09.294406 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1627b733-fa91-4f92-ba99-2ddd03666810 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.182088 Jul 28 06:38:09.295547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 71/146] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:09 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:09.849680 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ae33928f-09f8-4499-99a3-3ebc21e48f76 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:09.850275 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ae33928f-09f8-4499-99a3-3ebc21e48f76 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:09.859629 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae33928f-09f8-4499-99a3-3ebc21e48f76 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:09.860065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae33928f-09f8-4499-99a3-3ebc21e48f76 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:09.864458 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae33928f-09f8-4499-99a3-3ebc21e48f76 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:09.864985 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae33928f-09f8-4499-99a3-3ebc21e48f76 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:09.919113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-23e3b6ac-f973-4c89-8816-e906e75bd668 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:09.920127 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-23e3b6ac-f973-4c89-8816-e906e75bd668 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:09.932087 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23e3b6ac-f973-4c89-8816-e906e75bd668 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:09.932538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23e3b6ac-f973-4c89-8816-e906e75bd668 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:09.934031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23e3b6ac-f973-4c89-8816-e906e75bd668 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:09.934471 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23e3b6ac-f973-4c89-8816-e906e75bd668 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:10.071019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ae33928f-09f8-4499-99a3-3ebc21e48f76 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:10.079796 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ae33928f-09f8-4499-99a3-3ebc21e48f76 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:10.082412 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ae33928f-09f8-4499-99a3-3ebc21e48f76 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:10.083991 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ae33928f-09f8-4499-99a3-3ebc21e48f76 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.239928 Jul 28 06:38:10.097934 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 76/147] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:09 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:38:10.124232 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-23e3b6ac-f973-4c89-8816-e906e75bd668 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:10.135701 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-23e3b6ac-f973-4c89-8816-e906e75bd668 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.221272 Jul 28 06:38:10.136535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 72/148] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:09 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:10.196103 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d7616da1-53dc-486d-8a79-94e3b13d10d6 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a366b4f2-082c-46b4-9d27-6def3e2d26dd"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:10.198522 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d7616da1-53dc-486d-8a79-94e3b13d10d6 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:10.205514 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7616da1-53dc-486d-8a79-94e3b13d10d6 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:10.206489 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7616da1-53dc-486d-8a79-94e3b13d10d6 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:10.207265 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7616da1-53dc-486d-8a79-94e3b13d10d6 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:10.207746 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7616da1-53dc-486d-8a79-94e3b13d10d6 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:10.279313 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-fbdbf20d-29fd-49db-91e6-adb44093da84 req-f917fea3-24e7-4eee-a36c-3490638f300c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019e1e9c-7545-477a-bae9-47c555ae07e2", "name": "network-vif-plugged", "status": "completed", "tag": "626917cf-1bf9-47dd-b3eb-784f6c8fdad0"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:10.295210 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-fbdbf20d-29fd-49db-91e6-adb44093da84 req-f917fea3-24e7-4eee-a36c-3490638f300c service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:10.301172 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-fbdbf20d-29fd-49db-91e6-adb44093da84 req-f917fea3-24e7-4eee-a36c-3490638f300c service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:10.313808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-fbdbf20d-29fd-49db-91e6-adb44093da84 req-f917fea3-24e7-4eee-a36c-3490638f300c service nova] Creating event network-vif-plugged:626917cf-1bf9-47dd-b3eb-784f6c8fdad0 for instance 019e1e9c-7545-477a-bae9-47c555ae07e2 on hv-cinder-85060 Jul 28 06:38:10.320387 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-fbdbf20d-29fd-49db-91e6-adb44093da84 req-f917fea3-24e7-4eee-a36c-3490638f300c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044627 Jul 28 06:38:10.320984 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 73/149] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:38:10.327088 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1c10f252-f87c-490f-a730-2994c14441f5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:10.327985 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1c10f252-f87c-490f-a730-2994c14441f5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:10.336134 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1c10f252-f87c-490f-a730-2994c14441f5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:10.336670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1c10f252-f87c-490f-a730-2994c14441f5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:10.337547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1c10f252-f87c-490f-a730-2994c14441f5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:10.338053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1c10f252-f87c-490f-a730-2994c14441f5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:10.499222 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1c10f252-f87c-490f-a730-2994c14441f5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:10.510086 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1c10f252-f87c-490f-a730-2994c14441f5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.187621 Jul 28 06:38:10.511208 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 74/150] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:10 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:11.057448 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d7616da1-53dc-486d-8a79-94e3b13d10d6 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "POST /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864966 Jul 28 06:38:11.058340 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 77/151] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:38:10 2022] POST /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972/os-volume_attachments => generated 194 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:38:11.108624 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7f5cb8c5-1ebf-40da-a399-8d6cbcd3f212 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:11.109242 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7f5cb8c5-1ebf-40da-a399-8d6cbcd3f212 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:11.118416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7f5cb8c5-1ebf-40da-a399-8d6cbcd3f212 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:11.118884 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7f5cb8c5-1ebf-40da-a399-8d6cbcd3f212 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:11.119650 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7f5cb8c5-1ebf-40da-a399-8d6cbcd3f212 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:11.120079 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7f5cb8c5-1ebf-40da-a399-8d6cbcd3f212 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:11.168607 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d1c4c16c-aa9c-4e20-aa55-2563d7a34283 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:11.168607 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d1c4c16c-aa9c-4e20-aa55-2563d7a34283 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:11.185662 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d1c4c16c-aa9c-4e20-aa55-2563d7a34283 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:11.189966 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d1c4c16c-aa9c-4e20-aa55-2563d7a34283 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:11.191786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d1c4c16c-aa9c-4e20-aa55-2563d7a34283 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:11.194833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d1c4c16c-aa9c-4e20-aa55-2563d7a34283 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:11.420205 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7f5cb8c5-1ebf-40da-a399-8d6cbcd3f212 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:11.438782 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7f5cb8c5-1ebf-40da-a399-8d6cbcd3f212 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:11.441416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7f5cb8c5-1ebf-40da-a399-8d6cbcd3f212 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:11.442592 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7f5cb8c5-1ebf-40da-a399-8d6cbcd3f212 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.338513 Jul 28 06:38:11.475874 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 75/152] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:11 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:38:11.486521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d1c4c16c-aa9c-4e20-aa55-2563d7a34283 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:11.506433 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d1c4c16c-aa9c-4e20-aa55-2563d7a34283 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1321 microversion: 2.1 time: 0.353694 Jul 28 06:38:11.508106 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 78/153] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:11 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:11.532138 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2d477424-5079-4b07-823c-16223a26546a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:11.532754 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2d477424-5079-4b07-823c-16223a26546a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:11.539438 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d477424-5079-4b07-823c-16223a26546a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:11.539832 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d477424-5079-4b07-823c-16223a26546a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:11.540781 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d477424-5079-4b07-823c-16223a26546a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:11.541203 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d477424-5079-4b07-823c-16223a26546a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:11.744176 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2d477424-5079-4b07-823c-16223a26546a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:11.753612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2d477424-5079-4b07-823c-16223a26546a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.225244 Jul 28 06:38:11.767311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 76/154] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:11 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:12.470385 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1201717e-c68a-443b-ba82-c5b81c84476d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:12.470997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1201717e-c68a-443b-ba82-c5b81c84476d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:12.488985 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1201717e-c68a-443b-ba82-c5b81c84476d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:12.489835 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1201717e-c68a-443b-ba82-c5b81c84476d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:12.490929 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1201717e-c68a-443b-ba82-c5b81c84476d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:12.491582 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1201717e-c68a-443b-ba82-c5b81c84476d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:12.532509 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-fcd6c22a-5df1-49a6-bede-bd3ff5167607 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:12.533185 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-fcd6c22a-5df1-49a6-bede-bd3ff5167607 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:12.539791 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:12.552651 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fcd6c22a-5df1-49a6-bede-bd3ff5167607 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:12.553109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fcd6c22a-5df1-49a6-bede-bd3ff5167607 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:12.556717 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fcd6c22a-5df1-49a6-bede-bd3ff5167607 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:12.556939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fcd6c22a-5df1-49a6-bede-bd3ff5167607 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:12.734226 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1201717e-c68a-443b-ba82-c5b81c84476d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:12.745464 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1201717e-c68a-443b-ba82-c5b81c84476d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:12.747116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1201717e-c68a-443b-ba82-c5b81c84476d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:12.748478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1201717e-c68a-443b-ba82-c5b81c84476d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1406 microversion: 2.20 time: 0.282289 Jul 28 06:38:12.754259 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 79/155] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:12 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:38:12.780854 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-19142f2a-6c3b-4d90-8342-53dc4216ae96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:12.784498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-19142f2a-6c3b-4d90-8342-53dc4216ae96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:12.793887 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-19142f2a-6c3b-4d90-8342-53dc4216ae96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:12.794340 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-19142f2a-6c3b-4d90-8342-53dc4216ae96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:12.796276 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-19142f2a-6c3b-4d90-8342-53dc4216ae96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:12.797104 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-19142f2a-6c3b-4d90-8342-53dc4216ae96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:12.856599 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-fcd6c22a-5df1-49a6-bede-bd3ff5167607 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:12.867993 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-fcd6c22a-5df1-49a6-bede-bd3ff5167607 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1516 microversion: 2.1 time: 0.340045 Jul 28 06:38:12.881324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 77/156] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:12 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1516 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:12.901515 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-8b31a631-011d-4dd3-8a41-6a30a2c7229e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:12.903847 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-8b31a631-011d-4dd3-8a41-6a30a2c7229e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:12.919152 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b31a631-011d-4dd3-8a41-6a30a2c7229e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:12.919607 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b31a631-011d-4dd3-8a41-6a30a2c7229e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:12.920396 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b31a631-011d-4dd3-8a41-6a30a2c7229e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:12.920835 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b31a631-011d-4dd3-8a41-6a30a2c7229e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:12.993549 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-8b31a631-011d-4dd3-8a41-6a30a2c7229e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lazy-loading 'flavor' on Instance uuid 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:38:13.116241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-19142f2a-6c3b-4d90-8342-53dc4216ae96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:13.126321 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-19142f2a-6c3b-4d90-8342-53dc4216ae96 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.353681 Jul 28 06:38:13.138081 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 80/157] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:12 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:13.169316 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-8b31a631-011d-4dd3-8a41-6a30a2c7229e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc/action" status: 200 len: 32 microversion: 2.1 time: 0.278454 Jul 28 06:38:13.173806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 78/158] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:38:12 2022] POST /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc/action => generated 32 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:38:13.181020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-84000af1-437b-45a9-aeaf-d3560ab85189 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:13.181943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-84000af1-437b-45a9-aeaf-d3560ab85189 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:13.199025 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-84000af1-437b-45a9-aeaf-d3560ab85189 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:13.199459 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-84000af1-437b-45a9-aeaf-d3560ab85189 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:13.200611 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-84000af1-437b-45a9-aeaf-d3560ab85189 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:13.201196 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-84000af1-437b-45a9-aeaf-d3560ab85189 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:13.378492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-1b0eed8b-8b4e-40a2-934a-dd342fc284d7 req-7a6d6daa-dda7-44b6-b754-781c36a7a894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3", "name": "network-vif-plugged", "status": "completed", "tag": "b1d18864-af4e-41d6-b3f8-a68f95159ee7"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:13.411307 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-1b0eed8b-8b4e-40a2-934a-dd342fc284d7 req-7a6d6daa-dda7-44b6-b754-781c36a7a894 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:13.415356 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-1b0eed8b-8b4e-40a2-934a-dd342fc284d7 req-7a6d6daa-dda7-44b6-b754-781c36a7a894 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:13.429907 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-84000af1-437b-45a9-aeaf-d3560ab85189 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:13.441900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-84000af1-437b-45a9-aeaf-d3560ab85189 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.264653 Jul 28 06:38:13.442487 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 81/159] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:13 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:13.453594 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-1b0eed8b-8b4e-40a2-934a-dd342fc284d7 req-7a6d6daa-dda7-44b6-b754-781c36a7a894 service nova] Creating event network-vif-plugged:b1d18864-af4e-41d6-b3f8-a68f95159ee7 for instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 on hv-cinder-85060 Jul 28 06:38:13.457386 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-1b0eed8b-8b4e-40a2-934a-dd342fc284d7 req-7a6d6daa-dda7-44b6-b754-781c36a7a894 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079941 Jul 28 06:38:13.457386 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 79/160] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:38:13.772511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8af45388-5fc4-43d9-9226-310bc440a7e8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:13.773986 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8af45388-5fc4-43d9-9226-310bc440a7e8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:13.782871 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8af45388-5fc4-43d9-9226-310bc440a7e8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:13.783527 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8af45388-5fc4-43d9-9226-310bc440a7e8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:13.785122 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8af45388-5fc4-43d9-9226-310bc440a7e8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:13.785933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8af45388-5fc4-43d9-9226-310bc440a7e8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:13.952398 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8af45388-5fc4-43d9-9226-310bc440a7e8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:13.962050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8af45388-5fc4-43d9-9226-310bc440a7e8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:13.963896 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8af45388-5fc4-43d9-9226-310bc440a7e8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:13.965114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8af45388-5fc4-43d9-9226-310bc440a7e8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1597 microversion: 2.20 time: 0.197700 Jul 28 06:38:13.977509 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 82/161] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:38:13 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1597 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:38:13.990581 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d9d7ab31-d3db-4c27-9a5b-0a33b2b0cb0a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:13.991241 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d9d7ab31-d3db-4c27-9a5b-0a33b2b0cb0a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:13.999081 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d9d7ab31-d3db-4c27-9a5b-0a33b2b0cb0a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:13.999560 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d9d7ab31-d3db-4c27-9a5b-0a33b2b0cb0a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:14.000641 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d9d7ab31-d3db-4c27-9a5b-0a33b2b0cb0a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:14.001507 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d9d7ab31-d3db-4c27-9a5b-0a33b2b0cb0a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:14.095818 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d9d7ab31-d3db-4c27-9a5b-0a33b2b0cb0a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.110591 Jul 28 06:38:14.097207 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 80/162] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Jul 28 06:38:13 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:38:14.154996 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b553c3a4-a17b-4e25-8fde-58355d163ad9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:14.155629 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b553c3a4-a17b-4e25-8fde-58355d163ad9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:14.159704 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:14.165263 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b553c3a4-a17b-4e25-8fde-58355d163ad9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:14.165828 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b553c3a4-a17b-4e25-8fde-58355d163ad9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:14.166650 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b553c3a4-a17b-4e25-8fde-58355d163ad9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:14.167321 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b553c3a4-a17b-4e25-8fde-58355d163ad9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:14.352734 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b553c3a4-a17b-4e25-8fde-58355d163ad9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:14.364334 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b553c3a4-a17b-4e25-8fde-58355d163ad9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.213078 Jul 28 06:38:14.382099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 83/163] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:14 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:14.464628 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-76d9fee5-4457-411c-a8a4-c8caf07a0ef6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:14.465315 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-76d9fee5-4457-411c-a8a4-c8caf07a0ef6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:14.472185 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-76d9fee5-4457-411c-a8a4-c8caf07a0ef6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:14.472954 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-76d9fee5-4457-411c-a8a4-c8caf07a0ef6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:14.489352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-76d9fee5-4457-411c-a8a4-c8caf07a0ef6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:14.490126 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-76d9fee5-4457-411c-a8a4-c8caf07a0ef6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:15.102812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-76d9fee5-4457-411c-a8a4-c8caf07a0ef6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:15.111414 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-76d9fee5-4457-411c-a8a4-c8caf07a0ef6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.650883 Jul 28 06:38:15.112471 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 81/164] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:14 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:15.391073 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1fe8d0e5-55b1-41d7-9e17-0008820533d0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:15.391677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1fe8d0e5-55b1-41d7-9e17-0008820533d0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:15.398428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1fe8d0e5-55b1-41d7-9e17-0008820533d0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:15.399079 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1fe8d0e5-55b1-41d7-9e17-0008820533d0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:15.400040 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1fe8d0e5-55b1-41d7-9e17-0008820533d0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:15.400473 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1fe8d0e5-55b1-41d7-9e17-0008820533d0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:15.592785 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1fe8d0e5-55b1-41d7-9e17-0008820533d0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:15.594973 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:15.604031 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1fe8d0e5-55b1-41d7-9e17-0008820533d0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.216752 Jul 28 06:38:15.605250 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 84/165] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:15 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:15.796836 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-8a51ef84-48f4-484a-b881-9e69e784d3ed req-d6f843a4-da4f-4f14-bdf5-2486582e16f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019e1e9c-7545-477a-bae9-47c555ae07e2", "tag": "626917cf-1bf9-47dd-b3eb-784f6c8fdad0"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:15.812318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-8a51ef84-48f4-484a-b881-9e69e784d3ed req-d6f843a4-da4f-4f14-bdf5-2486582e16f4 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:15.813371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-8a51ef84-48f4-484a-b881-9e69e784d3ed req-d6f843a4-da4f-4f14-bdf5-2486582e16f4 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:15.829732 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-8a51ef84-48f4-484a-b881-9e69e784d3ed req-d6f843a4-da4f-4f14-bdf5-2486582e16f4 service nova] Creating event network-changed:626917cf-1bf9-47dd-b3eb-784f6c8fdad0 for instance 019e1e9c-7545-477a-bae9-47c555ae07e2 on hv-cinder-85060 Jul 28 06:38:15.837258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-8a51ef84-48f4-484a-b881-9e69e784d3ed req-d6f843a4-da4f-4f14-bdf5-2486582e16f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044020 Jul 28 06:38:15.838405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 82/166] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:38:16.139338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e84eab6d-0d38-416f-88aa-571342a05400 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:16.139984 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e84eab6d-0d38-416f-88aa-571342a05400 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:16.151360 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e84eab6d-0d38-416f-88aa-571342a05400 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:16.151990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e84eab6d-0d38-416f-88aa-571342a05400 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:16.153243 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e84eab6d-0d38-416f-88aa-571342a05400 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:16.153703 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e84eab6d-0d38-416f-88aa-571342a05400 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:16.327161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e84eab6d-0d38-416f-88aa-571342a05400 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:16.336765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e84eab6d-0d38-416f-88aa-571342a05400 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.205189 Jul 28 06:38:16.350086 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 85/167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:16 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:16.630174 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d381cdda-4f3b-4f3d-93b6-90dbbe4b2983 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:16.631378 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d381cdda-4f3b-4f3d-93b6-90dbbe4b2983 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:16.638758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d381cdda-4f3b-4f3d-93b6-90dbbe4b2983 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:16.639565 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d381cdda-4f3b-4f3d-93b6-90dbbe4b2983 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:16.640370 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d381cdda-4f3b-4f3d-93b6-90dbbe4b2983 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:16.640805 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d381cdda-4f3b-4f3d-93b6-90dbbe4b2983 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:16.787406 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d381cdda-4f3b-4f3d-93b6-90dbbe4b2983 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:16.795418 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d381cdda-4f3b-4f3d-93b6-90dbbe4b2983 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.171449 Jul 28 06:38:16.795991 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 83/168] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:16 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:17.358916 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-79ed8c5e-bfec-48b2-99e0-3b96bc299797 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:17.359508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-79ed8c5e-bfec-48b2-99e0-3b96bc299797 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:17.366479 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79ed8c5e-bfec-48b2-99e0-3b96bc299797 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:17.366919 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79ed8c5e-bfec-48b2-99e0-3b96bc299797 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:17.367670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79ed8c5e-bfec-48b2-99e0-3b96bc299797 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:17.368099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79ed8c5e-bfec-48b2-99e0-3b96bc299797 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:17.505835 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-79ed8c5e-bfec-48b2-99e0-3b96bc299797 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:17.514191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-79ed8c5e-bfec-48b2-99e0-3b96bc299797 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.158982 Jul 28 06:38:17.514851 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 86/169] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:17 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:17.817877 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-67ae56b8-ad01-4864-accf-b7b70a395f43 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:17.819353 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-67ae56b8-ad01-4864-accf-b7b70a395f43 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:17.825550 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-67ae56b8-ad01-4864-accf-b7b70a395f43 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:17.825888 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-67ae56b8-ad01-4864-accf-b7b70a395f43 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:17.826797 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-67ae56b8-ad01-4864-accf-b7b70a395f43 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:17.827237 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-67ae56b8-ad01-4864-accf-b7b70a395f43 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:18.228370 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-67ae56b8-ad01-4864-accf-b7b70a395f43 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:18.241575 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-67ae56b8-ad01-4864-accf-b7b70a395f43 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.429035 Jul 28 06:38:18.243452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 84/170] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:17 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:18.536493 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-baa4f8db-956f-4a7a-8ba4-b36966d63da0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:18.537111 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-baa4f8db-956f-4a7a-8ba4-b36966d63da0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:18.546598 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baa4f8db-956f-4a7a-8ba4-b36966d63da0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:18.547033 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baa4f8db-956f-4a7a-8ba4-b36966d63da0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:18.547752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baa4f8db-956f-4a7a-8ba4-b36966d63da0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:18.548394 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baa4f8db-956f-4a7a-8ba4-b36966d63da0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:18.791115 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-baa4f8db-956f-4a7a-8ba4-b36966d63da0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:18.800105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-baa4f8db-956f-4a7a-8ba4-b36966d63da0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.268199 Jul 28 06:38:18.801018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 87/171] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:18 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:19.266957 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-61382215-1726-41ea-8404-2c2ace4168ce tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:19.267664 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-61382215-1726-41ea-8404-2c2ace4168ce tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:19.274920 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61382215-1726-41ea-8404-2c2ace4168ce tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:19.275436 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61382215-1726-41ea-8404-2c2ace4168ce tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:19.276231 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61382215-1726-41ea-8404-2c2ace4168ce tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:19.276668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61382215-1726-41ea-8404-2c2ace4168ce tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:19.413270 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-61382215-1726-41ea-8404-2c2ace4168ce tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:19.421071 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-61382215-1726-41ea-8404-2c2ace4168ce tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.158323 Jul 28 06:38:19.421682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 85/172] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:19 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:19.836208 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ee616bd9-4d56-4803-8365-41b8f91efde9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:19.836831 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ee616bd9-4d56-4803-8365-41b8f91efde9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:19.843491 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ee616bd9-4d56-4803-8365-41b8f91efde9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:19.843944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ee616bd9-4d56-4803-8365-41b8f91efde9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:19.844713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ee616bd9-4d56-4803-8365-41b8f91efde9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:19.845136 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ee616bd9-4d56-4803-8365-41b8f91efde9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:20.006222 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ee616bd9-4d56-4803-8365-41b8f91efde9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:20.015201 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ee616bd9-4d56-4803-8365-41b8f91efde9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.183296 Jul 28 06:38:20.016602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 88/173] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:19 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:20.442683 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-87f5c056-3b2e-4440-995d-d7bfcbd7f040 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:20.443930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-87f5c056-3b2e-4440-995d-d7bfcbd7f040 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:20.450720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87f5c056-3b2e-4440-995d-d7bfcbd7f040 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:20.451258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87f5c056-3b2e-4440-995d-d7bfcbd7f040 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:20.452093 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87f5c056-3b2e-4440-995d-d7bfcbd7f040 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:20.452526 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87f5c056-3b2e-4440-995d-d7bfcbd7f040 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:20.591877 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-87f5c056-3b2e-4440-995d-d7bfcbd7f040 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:20.601797 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-87f5c056-3b2e-4440-995d-d7bfcbd7f040 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.162813 Jul 28 06:38:20.602570 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 86/174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:20 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:21.040676 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3281b50f-3a1d-4b14-8f2d-278f6bdabe0e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:21.041286 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3281b50f-3a1d-4b14-8f2d-278f6bdabe0e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:21.048051 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3281b50f-3a1d-4b14-8f2d-278f6bdabe0e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:21.048490 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3281b50f-3a1d-4b14-8f2d-278f6bdabe0e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:21.049245 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3281b50f-3a1d-4b14-8f2d-278f6bdabe0e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:21.049711 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3281b50f-3a1d-4b14-8f2d-278f6bdabe0e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:21.180323 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3281b50f-3a1d-4b14-8f2d-278f6bdabe0e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:21.187997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3281b50f-3a1d-4b14-8f2d-278f6bdabe0e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.152064 Jul 28 06:38:21.188781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 89/175] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:21 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:21.623939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b6b81b7d-e4c7-4bce-a29b-25030cc532c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:21.624578 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b6b81b7d-e4c7-4bce-a29b-25030cc532c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:21.631267 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b6b81b7d-e4c7-4bce-a29b-25030cc532c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:21.631722 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b6b81b7d-e4c7-4bce-a29b-25030cc532c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:21.632492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b6b81b7d-e4c7-4bce-a29b-25030cc532c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:21.632936 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b6b81b7d-e4c7-4bce-a29b-25030cc532c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:21.769496 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b6b81b7d-e4c7-4bce-a29b-25030cc532c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:21.773239 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:21.778303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b6b81b7d-e4c7-4bce-a29b-25030cc532c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.158194 Jul 28 06:38:21.778958 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 87/176] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:21 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:22.211464 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-636a0fa7-9075-48e4-8907-7265b2e25fec tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:22.212191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-636a0fa7-9075-48e4-8907-7265b2e25fec tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:22.219049 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-636a0fa7-9075-48e4-8907-7265b2e25fec tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:22.219495 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-636a0fa7-9075-48e4-8907-7265b2e25fec tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:22.220451 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-636a0fa7-9075-48e4-8907-7265b2e25fec tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:22.220885 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-636a0fa7-9075-48e4-8907-7265b2e25fec tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:22.360161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-636a0fa7-9075-48e4-8907-7265b2e25fec tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:22.367972 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-636a0fa7-9075-48e4-8907-7265b2e25fec tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.160568 Jul 28 06:38:22.368550 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 90/177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:22 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:22.800479 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-28fa861c-cdc5-4b4d-a03a-7ef09758a123 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:22.800974 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-28fa861c-cdc5-4b4d-a03a-7ef09758a123 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:22.807934 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-28fa861c-cdc5-4b4d-a03a-7ef09758a123 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:22.808460 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-28fa861c-cdc5-4b4d-a03a-7ef09758a123 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:22.809336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-28fa861c-cdc5-4b4d-a03a-7ef09758a123 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:22.809841 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-28fa861c-cdc5-4b4d-a03a-7ef09758a123 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:23.051978 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-28fa861c-cdc5-4b4d-a03a-7ef09758a123 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:23.063390 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-28fa861c-cdc5-4b4d-a03a-7ef09758a123 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.268012 Jul 28 06:38:23.074784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 88/178] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:22 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:23.401576 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a3200ebc-6968-479d-8f52-64fd41450b1c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:23.404124 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a3200ebc-6968-479d-8f52-64fd41450b1c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:23.412977 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a3200ebc-6968-479d-8f52-64fd41450b1c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:23.413471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a3200ebc-6968-479d-8f52-64fd41450b1c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:23.414239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a3200ebc-6968-479d-8f52-64fd41450b1c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:23.414678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a3200ebc-6968-479d-8f52-64fd41450b1c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:23.564061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a3200ebc-6968-479d-8f52-64fd41450b1c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:23.575153 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a3200ebc-6968-479d-8f52-64fd41450b1c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.180107 Jul 28 06:38:23.576016 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 91/179] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:23 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:24.087157 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a0687eb4-ec92-4ae2-ba0b-4f281f3cb795 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:24.088169 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a0687eb4-ec92-4ae2-ba0b-4f281f3cb795 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:24.094622 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0687eb4-ec92-4ae2-ba0b-4f281f3cb795 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:24.095077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0687eb4-ec92-4ae2-ba0b-4f281f3cb795 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:24.095848 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0687eb4-ec92-4ae2-ba0b-4f281f3cb795 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:24.096938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0687eb4-ec92-4ae2-ba0b-4f281f3cb795 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:24.259194 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a0687eb4-ec92-4ae2-ba0b-4f281f3cb795 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:24.269473 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a0687eb4-ec92-4ae2-ba0b-4f281f3cb795 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1366 microversion: 2.1 time: 0.185450 Jul 28 06:38:24.269770 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 89/180] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:24 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:24.604133 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c5fd9b90-e4e6-438f-a512-f7370ca14db3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:24.605483 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c5fd9b90-e4e6-438f-a512-f7370ca14db3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:24.617421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c5fd9b90-e4e6-438f-a512-f7370ca14db3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:24.618092 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c5fd9b90-e4e6-438f-a512-f7370ca14db3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:24.619327 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c5fd9b90-e4e6-438f-a512-f7370ca14db3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:24.620189 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c5fd9b90-e4e6-438f-a512-f7370ca14db3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:24.781505 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c5fd9b90-e4e6-438f-a512-f7370ca14db3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:24.796655 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c5fd9b90-e4e6-438f-a512-f7370ca14db3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.196214 Jul 28 06:38:24.813814 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 92/181] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:24 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:25.300069 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b689c688-d9b4-4b22-a11b-da3cbd72fe91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:25.301718 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b689c688-d9b4-4b22-a11b-da3cbd72fe91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:25.308423 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b689c688-d9b4-4b22-a11b-da3cbd72fe91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:25.308804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b689c688-d9b4-4b22-a11b-da3cbd72fe91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:25.309723 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b689c688-d9b4-4b22-a11b-da3cbd72fe91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:25.310319 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b689c688-d9b4-4b22-a11b-da3cbd72fe91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:25.491533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b689c688-d9b4-4b22-a11b-da3cbd72fe91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:25.501165 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b689c688-d9b4-4b22-a11b-da3cbd72fe91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1556 microversion: 2.1 time: 0.205499 Jul 28 06:38:25.501747 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 90/182] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:25 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1556 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:25.525213 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-222f5256-de15-4dce-ab78-8099e748ccc8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:25.525788 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-222f5256-de15-4dce-ab78-8099e748ccc8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:25.541556 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-222f5256-de15-4dce-ab78-8099e748ccc8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:25.542057 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-222f5256-de15-4dce-ab78-8099e748ccc8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:25.542874 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-222f5256-de15-4dce-ab78-8099e748ccc8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:25.543340 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-222f5256-de15-4dce-ab78-8099e748ccc8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:25.651560 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-222f5256-de15-4dce-ab78-8099e748ccc8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130423 Jul 28 06:38:25.652208 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 93/183] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Jul 28 06:38:25 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:38:25.820403 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-169c5e64-f437-43e0-bda0-925ba85238f7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:25.821156 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-169c5e64-f437-43e0-bda0-925ba85238f7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:25.827598 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-169c5e64-f437-43e0-bda0-925ba85238f7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:25.828321 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-169c5e64-f437-43e0-bda0-925ba85238f7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:25.829171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-169c5e64-f437-43e0-bda0-925ba85238f7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:25.829697 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-169c5e64-f437-43e0-bda0-925ba85238f7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:26.017171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-169c5e64-f437-43e0-bda0-925ba85238f7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:26.031517 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-169c5e64-f437-43e0-bda0-925ba85238f7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.215037 Jul 28 06:38:26.041754 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 91/184] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:25 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:27.055405 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c151d482-73b1-4df9-994f-6b2eec0b1bdd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:27.056028 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c151d482-73b1-4df9-994f-6b2eec0b1bdd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:27.063327 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c151d482-73b1-4df9-994f-6b2eec0b1bdd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:27.063781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c151d482-73b1-4df9-994f-6b2eec0b1bdd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:27.064680 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c151d482-73b1-4df9-994f-6b2eec0b1bdd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:27.065865 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c151d482-73b1-4df9-994f-6b2eec0b1bdd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:27.137721 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-d139a08e-a690-4b1a-a826-a63b391305aa req-5dc9c984-1367-4961-81be-4db9e1196aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3", "tag": "b1d18864-af4e-41d6-b3f8-a68f95159ee7"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:27.156914 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-d139a08e-a690-4b1a-a826-a63b391305aa req-5dc9c984-1367-4961-81be-4db9e1196aaf service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:27.157386 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-d139a08e-a690-4b1a-a826-a63b391305aa req-5dc9c984-1367-4961-81be-4db9e1196aaf service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:27.170556 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-d139a08e-a690-4b1a-a826-a63b391305aa req-5dc9c984-1367-4961-81be-4db9e1196aaf service nova] Creating event network-changed:b1d18864-af4e-41d6-b3f8-a68f95159ee7 for instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 on hv-cinder-85060 Jul 28 06:38:27.177186 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-d139a08e-a690-4b1a-a826-a63b391305aa req-5dc9c984-1367-4961-81be-4db9e1196aaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042821 Jul 28 06:38:27.178985 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 92/185] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:38:27.244044 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c151d482-73b1-4df9-994f-6b2eec0b1bdd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:27.256637 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c151d482-73b1-4df9-994f-6b2eec0b1bdd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.204830 Jul 28 06:38:27.258121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 94/186] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:27 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:28.280410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-91ee3c39-ecf1-408a-97ba-bdfdb3f3a7ff tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:28.281791 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-91ee3c39-ecf1-408a-97ba-bdfdb3f3a7ff tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:28.290073 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91ee3c39-ecf1-408a-97ba-bdfdb3f3a7ff tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:28.290700 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91ee3c39-ecf1-408a-97ba-bdfdb3f3a7ff tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:28.291545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91ee3c39-ecf1-408a-97ba-bdfdb3f3a7ff tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:28.292072 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91ee3c39-ecf1-408a-97ba-bdfdb3f3a7ff tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:28.434892 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-91ee3c39-ecf1-408a-97ba-bdfdb3f3a7ff tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:28.443526 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-91ee3c39-ecf1-408a-97ba-bdfdb3f3a7ff tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.167902 Jul 28 06:38:28.444349 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 93/187] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:28 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:29.465708 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-20963c01-321f-4085-a1f2-efa3b042afe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:29.466319 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-20963c01-321f-4085-a1f2-efa3b042afe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:29.473230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-20963c01-321f-4085-a1f2-efa3b042afe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:29.473716 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-20963c01-321f-4085-a1f2-efa3b042afe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:29.474471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-20963c01-321f-4085-a1f2-efa3b042afe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:29.474904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-20963c01-321f-4085-a1f2-efa3b042afe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:29.603056 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-20963c01-321f-4085-a1f2-efa3b042afe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:29.610959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-20963c01-321f-4085-a1f2-efa3b042afe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.149116 Jul 28 06:38:29.612110 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 95/188] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:29 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:30.514708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f7f99280-976d-4886-8dcd-be8a9bcfbf9b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:30.515217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f7f99280-976d-4886-8dcd-be8a9bcfbf9b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:30.522401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f7f99280-976d-4886-8dcd-be8a9bcfbf9b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:30.522856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f7f99280-976d-4886-8dcd-be8a9bcfbf9b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:30.523658 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f7f99280-976d-4886-8dcd-be8a9bcfbf9b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:30.524098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f7f99280-976d-4886-8dcd-be8a9bcfbf9b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:30.550374 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f7f99280-976d-4886-8dcd-be8a9bcfbf9b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:38:30.649347 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-86831a99-e568-4bed-8c8b-41cce62fb3be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:30.649949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-86831a99-e568-4bed-8c8b-41cce62fb3be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:30.650813 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f7f99280-976d-4886-8dcd-be8a9bcfbf9b tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 204 len: 0 microversion: 2.1 time: 0.139315 Jul 28 06:38:30.651954 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 94/189] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:38:30 2022] DELETE /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:38:30.661285 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c73ade8b-2c97-47d7-9ccc-0db136cd1338 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:30.662190 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c73ade8b-2c97-47d7-9ccc-0db136cd1338 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:30.662717 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-86831a99-e568-4bed-8c8b-41cce62fb3be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:30.663331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-86831a99-e568-4bed-8c8b-41cce62fb3be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:30.664535 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-86831a99-e568-4bed-8c8b-41cce62fb3be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:30.665244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-86831a99-e568-4bed-8c8b-41cce62fb3be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:30.670649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c73ade8b-2c97-47d7-9ccc-0db136cd1338 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:30.671341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c73ade8b-2c97-47d7-9ccc-0db136cd1338 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:30.672414 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c73ade8b-2c97-47d7-9ccc-0db136cd1338 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:30.673265 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c73ade8b-2c97-47d7-9ccc-0db136cd1338 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:30.821435 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c73ade8b-2c97-47d7-9ccc-0db136cd1338 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:30.821602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-86831a99-e568-4bed-8c8b-41cce62fb3be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:30.829331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-86831a99-e568-4bed-8c8b-41cce62fb3be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.199666 Jul 28 06:38:30.830121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 96/190] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:30 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:30.831489 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c73ade8b-2c97-47d7-9ccc-0db136cd1338 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1553 microversion: 2.1 time: 0.174919 Jul 28 06:38:30.832769 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 95/191] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:30 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:31.851542 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-462ac280-59af-4426-8edb-9908a8b093f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:31.852168 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-462ac280-59af-4426-8edb-9908a8b093f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:31.858724 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-462ac280-59af-4426-8edb-9908a8b093f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:31.859167 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-462ac280-59af-4426-8edb-9908a8b093f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:31.859920 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-462ac280-59af-4426-8edb-9908a8b093f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:31.860352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-462ac280-59af-4426-8edb-9908a8b093f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:31.860491 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f06e24b2-47b0-4496-bc5e-e3a38353c164 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:31.861067 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f06e24b2-47b0-4496-bc5e-e3a38353c164 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:31.867339 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f06e24b2-47b0-4496-bc5e-e3a38353c164 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:31.867787 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f06e24b2-47b0-4496-bc5e-e3a38353c164 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:31.868543 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f06e24b2-47b0-4496-bc5e-e3a38353c164 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:31.868971 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f06e24b2-47b0-4496-bc5e-e3a38353c164 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:31.999249 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-462ac280-59af-4426-8edb-9908a8b093f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:32.003729 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f06e24b2-47b0-4496-bc5e-e3a38353c164 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:32.007373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-462ac280-59af-4426-8edb-9908a8b093f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.159447 Jul 28 06:38:32.007958 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 97/192] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:31 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:32.011609 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f06e24b2-47b0-4496-bc5e-e3a38353c164 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1553 microversion: 2.1 time: 0.155059 Jul 28 06:38:32.012168 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 96/193] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:31 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:33.028712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-63bed7f3-f506-462c-93d1-5eb7e49cfa4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:33.029339 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-63bed7f3-f506-462c-93d1-5eb7e49cfa4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:33.032779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f045d411-cc39-43fa-a56e-a313cb9cd44f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:33.033512 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f045d411-cc39-43fa-a56e-a313cb9cd44f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:33.036716 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-63bed7f3-f506-462c-93d1-5eb7e49cfa4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:33.037165 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-63bed7f3-f506-462c-93d1-5eb7e49cfa4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:33.037997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-63bed7f3-f506-462c-93d1-5eb7e49cfa4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:33.038435 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-63bed7f3-f506-462c-93d1-5eb7e49cfa4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:33.039424 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f045d411-cc39-43fa-a56e-a313cb9cd44f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:33.039869 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f045d411-cc39-43fa-a56e-a313cb9cd44f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:33.040629 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f045d411-cc39-43fa-a56e-a313cb9cd44f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:33.041062 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f045d411-cc39-43fa-a56e-a313cb9cd44f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:33.170428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f045d411-cc39-43fa-a56e-a313cb9cd44f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:33.173430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-63bed7f3-f506-462c-93d1-5eb7e49cfa4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:33.179298 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f045d411-cc39-43fa-a56e-a313cb9cd44f tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1553 microversion: 2.1 time: 0.150172 Jul 28 06:38:33.180388 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 97/194] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:33 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:33.185537 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-63bed7f3-f506-462c-93d1-5eb7e49cfa4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.160783 Jul 28 06:38:33.186104 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 98/195] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:33 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:34.201195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-8b506676-2757-4519-90c7-d9144c4f5a3d tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:34.202343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-8b506676-2757-4519-90c7-d9144c4f5a3d tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:34.208174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-cf46cea4-bee8-46f5-be52-030679e98e2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:34.208932 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-cf46cea4-bee8-46f5-be52-030679e98e2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:34.210260 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b506676-2757-4519-90c7-d9144c4f5a3d tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:34.210786 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b506676-2757-4519-90c7-d9144c4f5a3d tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:34.211626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b506676-2757-4519-90c7-d9144c4f5a3d tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:34.212330 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b506676-2757-4519-90c7-d9144c4f5a3d tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:34.215706 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf46cea4-bee8-46f5-be52-030679e98e2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:34.216156 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf46cea4-bee8-46f5-be52-030679e98e2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:34.216995 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf46cea4-bee8-46f5-be52-030679e98e2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:34.217485 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf46cea4-bee8-46f5-be52-030679e98e2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:34.354637 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-cf46cea4-bee8-46f5-be52-030679e98e2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:34.355217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8b506676-2757-4519-90c7-d9144c4f5a3d tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:34.365614 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-cf46cea4-bee8-46f5-be52-030679e98e2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.161993 Jul 28 06:38:34.366194 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 99/196] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:34 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:34.368453 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-8b506676-2757-4519-90c7-d9144c4f5a3d tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1553 microversion: 2.1 time: 0.170989 Jul 28 06:38:34.369029 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 98/197] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:34 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:35.396493 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-fa7c85c3-189b-4f6a-8edf-bfef32cd0e91 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:35.397112 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-fa7c85c3-189b-4f6a-8edf-bfef32cd0e91 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:35.401252 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-103e6cb0-183a-4459-95a7-5c570b2e8e5e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:35.401908 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-103e6cb0-183a-4459-95a7-5c570b2e8e5e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:35.409406 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-103e6cb0-183a-4459-95a7-5c570b2e8e5e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:35.409860 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-103e6cb0-183a-4459-95a7-5c570b2e8e5e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:35.410629 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-103e6cb0-183a-4459-95a7-5c570b2e8e5e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:35.411691 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-103e6cb0-183a-4459-95a7-5c570b2e8e5e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:35.412011 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa7c85c3-189b-4f6a-8edf-bfef32cd0e91 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:35.412412 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa7c85c3-189b-4f6a-8edf-bfef32cd0e91 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:35.413171 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa7c85c3-189b-4f6a-8edf-bfef32cd0e91 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:35.413974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa7c85c3-189b-4f6a-8edf-bfef32cd0e91 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:35.566887 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-103e6cb0-183a-4459-95a7-5c570b2e8e5e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:35.581169 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-fa7c85c3-189b-4f6a-8edf-bfef32cd0e91 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:35.590864 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-fa7c85c3-189b-4f6a-8edf-bfef32cd0e91 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.198598 Jul 28 06:38:35.601498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 100/198] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:35 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:35.602280 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-103e6cb0-183a-4459-95a7-5c570b2e8e5e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1553 microversion: 2.1 time: 0.208830 Jul 28 06:38:35.602280 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 99/199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:35 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:36.613227 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3f6ae961-6c21-42fd-bf9b-0d806aaca4f1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:36.613967 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3f6ae961-6c21-42fd-bf9b-0d806aaca4f1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:36.617702 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-987242fc-faf1-4c04-90ec-fd7532fe2e4c tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:36.618308 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-987242fc-faf1-4c04-90ec-fd7532fe2e4c tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:36.620452 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3f6ae961-6c21-42fd-bf9b-0d806aaca4f1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:36.620904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3f6ae961-6c21-42fd-bf9b-0d806aaca4f1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:36.621694 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3f6ae961-6c21-42fd-bf9b-0d806aaca4f1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:36.622123 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3f6ae961-6c21-42fd-bf9b-0d806aaca4f1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:36.624687 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-987242fc-faf1-4c04-90ec-fd7532fe2e4c tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:36.625135 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-987242fc-faf1-4c04-90ec-fd7532fe2e4c tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:36.627200 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-987242fc-faf1-4c04-90ec-fd7532fe2e4c tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:36.627200 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-987242fc-faf1-4c04-90ec-fd7532fe2e4c tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:36.763154 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3f6ae961-6c21-42fd-bf9b-0d806aaca4f1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:36.765401 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:36.767718 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-987242fc-faf1-4c04-90ec-fd7532fe2e4c tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:36.772982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3f6ae961-6c21-42fd-bf9b-0d806aaca4f1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.163602 Jul 28 06:38:36.773603 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 101/200] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:36 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:36.776912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-987242fc-faf1-4c04-90ec-fd7532fe2e4c tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1553 microversion: 2.1 time: 0.163031 Jul 28 06:38:36.777490 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 100/201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:36 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:37.795641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7b2f3068-f728-43cc-9199-f81c844083c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:37.796374 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7b2f3068-f728-43cc-9199-f81c844083c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:37.797695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4c0ec949-4ef6-4cd7-9ba7-d85dd6c7994e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:37.798307 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4c0ec949-4ef6-4cd7-9ba7-d85dd6c7994e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:37.802982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7b2f3068-f728-43cc-9199-f81c844083c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:37.803424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7b2f3068-f728-43cc-9199-f81c844083c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:37.804183 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7b2f3068-f728-43cc-9199-f81c844083c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:37.804281 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4c0ec949-4ef6-4cd7-9ba7-d85dd6c7994e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:37.804615 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7b2f3068-f728-43cc-9199-f81c844083c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:37.804729 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4c0ec949-4ef6-4cd7-9ba7-d85dd6c7994e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:37.805480 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4c0ec949-4ef6-4cd7-9ba7-d85dd6c7994e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:37.805916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4c0ec949-4ef6-4cd7-9ba7-d85dd6c7994e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:37.935372 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4c0ec949-4ef6-4cd7-9ba7-d85dd6c7994e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:37.937970 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7b2f3068-f728-43cc-9199-f81c844083c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:37.945571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4c0ec949-4ef6-4cd7-9ba7-d85dd6c7994e tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1553 microversion: 2.1 time: 0.151497 Jul 28 06:38:37.945948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7b2f3068-f728-43cc-9199-f81c844083c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.154656 Jul 28 06:38:37.946150 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 101/202] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:37 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:37.946505 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 102/203] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:37 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:38.967762 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2eb88d45-fec2-45cb-abb2-a596863ecaeb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:38.968492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2eb88d45-fec2-45cb-abb2-a596863ecaeb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:38.973950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dced8184-fba4-45b5-8685-434571b8f285 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:38.974568 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-dced8184-fba4-45b5-8685-434571b8f285 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:38.975869 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2eb88d45-fec2-45cb-abb2-a596863ecaeb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:38.976607 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2eb88d45-fec2-45cb-abb2-a596863ecaeb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:38.977725 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2eb88d45-fec2-45cb-abb2-a596863ecaeb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:38.978254 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2eb88d45-fec2-45cb-abb2-a596863ecaeb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:38.986091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dced8184-fba4-45b5-8685-434571b8f285 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:38.986537 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dced8184-fba4-45b5-8685-434571b8f285 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:38.987440 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dced8184-fba4-45b5-8685-434571b8f285 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:38.988561 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dced8184-fba4-45b5-8685-434571b8f285 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:39.131555 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dced8184-fba4-45b5-8685-434571b8f285 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:39.139211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-dced8184-fba4-45b5-8685-434571b8f285 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.172003 Jul 28 06:38:39.139916 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 103/204] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:38 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:39.209125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2eb88d45-fec2-45cb-abb2-a596863ecaeb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:39.217929 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2eb88d45-fec2-45cb-abb2-a596863ecaeb tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1553 microversion: 2.1 time: 0.254228 Jul 28 06:38:39.218503 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 102/205] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:38 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:39.527826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-58b6fd0b-e71e-4609-b944-3fc26288a14d req-1865c5d6-4c92-4eaf-9de8-218f89fba7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1897c3-cdbe-4796-972b-29758824f972", "name": "network-vif-deleted", "tag": "c069b7a6-23c4-4f73-8439-bbaa0bf0be15"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:39.543285 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-58b6fd0b-e71e-4609-b944-3fc26288a14d req-1865c5d6-4c92-4eaf-9de8-218f89fba7e8 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:39.543579 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-58b6fd0b-e71e-4609-b944-3fc26288a14d req-1865c5d6-4c92-4eaf-9de8-218f89fba7e8 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:39.558556 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-58b6fd0b-e71e-4609-b944-3fc26288a14d req-1865c5d6-4c92-4eaf-9de8-218f89fba7e8 service nova] Creating event network-vif-deleted:c069b7a6-23c4-4f73-8439-bbaa0bf0be15 for instance 6b1897c3-cdbe-4796-972b-29758824f972 on hv-cinder-85060 Jul 28 06:38:39.564185 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-58b6fd0b-e71e-4609-b944-3fc26288a14d req-1865c5d6-4c92-4eaf-9de8-218f89fba7e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040531 Jul 28 06:38:39.564966 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 104/206] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:38:40.161987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-dbf4a5c2-0594-4189-85b5-5e85298cd406 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:40.162601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-dbf4a5c2-0594-4189-85b5-5e85298cd406 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:40.173889 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dbf4a5c2-0594-4189-85b5-5e85298cd406 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:40.174518 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dbf4a5c2-0594-4189-85b5-5e85298cd406 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:40.176326 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dbf4a5c2-0594-4189-85b5-5e85298cd406 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:40.177824 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dbf4a5c2-0594-4189-85b5-5e85298cd406 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:40.213084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:40.241661 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0abb1ef9-f8e6-467e-bec3-eb4b388c9083 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:40.242369 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0abb1ef9-f8e6-467e-bec3-eb4b388c9083 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:40.250292 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0abb1ef9-f8e6-467e-bec3-eb4b388c9083 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:40.251016 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0abb1ef9-f8e6-467e-bec3-eb4b388c9083 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:40.251861 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0abb1ef9-f8e6-467e-bec3-eb4b388c9083 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:40.252653 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0abb1ef9-f8e6-467e-bec3-eb4b388c9083 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:40.321326 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0abb1ef9-f8e6-467e-bec3-eb4b388c9083 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b240f68acc734bd492843ad4ac35807c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e7a5dae78a4c10926c6fb66458c71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:40.329633 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0abb1ef9-f8e6-467e-bec3-eb4b388c9083 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 200 len: 1345 microversion: 2.1 time: 0.093460 Jul 28 06:38:40.330205 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 105/207] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:40 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:40.392447 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-dbf4a5c2-0594-4189-85b5-5e85298cd406 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:40.399992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-dbf4a5c2-0594-4189-85b5-5e85298cd406 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.243334 Jul 28 06:38:40.400633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 103/208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:40 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:41.352960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ae3abff1-a253-43b6-b258-8b79dcd4f450 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:41.353614 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ae3abff1-a253-43b6-b258-8b79dcd4f450 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:41.359555 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae3abff1-a253-43b6-b258-8b79dcd4f450 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:41.360000 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae3abff1-a253-43b6-b258-8b79dcd4f450 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:41.360747 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae3abff1-a253-43b6-b258-8b79dcd4f450 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:41.361364 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae3abff1-a253-43b6-b258-8b79dcd4f450 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:41.376050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-ae3abff1-a253-43b6-b258-8b79dcd4f450 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] HTTP exception thrown: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ae3abff1-a253-43b6-b258-8b79dcd4f450 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Request method failure captured: Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 HTTP/1.1 Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6hY1XgJFO7FdmuMfdFKElGh-mCTL-Xn07JRj4jAyBwIZ9eEVwYKStSIODftqh9A9-Dx5DPOobC-ob7uRCdRlwdeoUQDqY5_MJn_MbQuunhClAAGKVNj1yYArjLSQ4vKnU4FQiiKxTmwQVYd5QCI2viLzk0z6qrU85y0f-VbJcvR34 Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: a0e7a5dae78a4c10926c6fb66458c71b Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:38:41.380786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0e7a5dae78a4c10926c6fb66458c71b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0e7a5dae78a4c10926c6fb66458c71b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0e7a5dae78a4c10926c6fb66458c71b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0e7a5dae78a4c10926c6fb66458c71b"}]}] Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: a0e7a5dae78a4c10926c6fb66458c71b Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-DeleteServersTestJSON-655935377-project Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: b240f68acc734bd492843ad4ac35807c Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-DeleteServersTestJSON-655935377-project Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:41.382388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '6b1897c3-cdbe-4796-972b-29758824f972'} Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:38:41.383377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:41.384827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:41.386048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ae3abff1-a253-43b6-b258-8b79dcd4f450 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Returning 404 to user: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:38:41.386048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ae3abff1-a253-43b6-b258-8b79dcd4f450 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 404 len: 111 microversion: 2.1 time: 0.034261 Jul 28 06:38:41.386048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 106/209] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:41 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:38:41.422020 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c841de0e-ae5c-4934-b4f3-afd080cc8f6b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:41.423143 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c841de0e-ae5c-4934-b4f3-afd080cc8f6b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:41.430571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c841de0e-ae5c-4934-b4f3-afd080cc8f6b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:41.431223 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c841de0e-ae5c-4934-b4f3-afd080cc8f6b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:41.432205 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c841de0e-ae5c-4934-b4f3-afd080cc8f6b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:41.432634 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c841de0e-ae5c-4934-b4f3-afd080cc8f6b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:41.537616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-562cb64c-9c0e-4fc4-ba64-219a805ae7b8 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:41.540004 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-562cb64c-9c0e-4fc4-ba64-219a805ae7b8 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:41.546296 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-562cb64c-9c0e-4fc4-ba64-219a805ae7b8 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:41.547207 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-562cb64c-9c0e-4fc4-ba64-219a805ae7b8 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:41.548180 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-562cb64c-9c0e-4fc4-ba64-219a805ae7b8 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:41.549065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-562cb64c-9c0e-4fc4-ba64-219a805ae7b8 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:41.567610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-562cb64c-9c0e-4fc4-ba64-219a805ae7b8 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] HTTP exception thrown: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-562cb64c-9c0e-4fc4-ba64-219a805ae7b8 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Request method failure captured: Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972/os-volume_attachments HTTP/1.1 Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6hY1XgJFO7FdmuMfdFKElGh-mCTL-Xn07JRj4jAyBwIZ9eEVwYKStSIODftqh9A9-Dx5DPOobC-ob7uRCdRlwdeoUQDqY5_MJn_MbQuunhClAAGKVNj1yYArjLSQ4vKnU4FQiiKxTmwQVYd5QCI2viLzk0z6qrU85y0f-VbJcvR34 Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: a0e7a5dae78a4c10926c6fb66458c71b Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:38:41.576504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0e7a5dae78a4c10926c6fb66458c71b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0e7a5dae78a4c10926c6fb66458c71b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0e7a5dae78a4c10926c6fb66458c71b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0e7a5dae78a4c10926c6fb66458c71b"}]}] Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: a0e7a5dae78a4c10926c6fb66458c71b Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-DeleteServersTestJSON-655935377-project Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: b240f68acc734bd492843ad4ac35807c Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-DeleteServersTestJSON-655935377-project Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:41.577880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'server_id': '6b1897c3-cdbe-4796-972b-29758824f972'} Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:38:41.578548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:41.579596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:41.583321 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-562cb64c-9c0e-4fc4-ba64-219a805ae7b8 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Returning 404 to user: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:38:41.584520 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-562cb64c-9c0e-4fc4-ba64-219a805ae7b8 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051217 Jul 28 06:38:41.585329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 107/210] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:38:41 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:38:41.596215 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c841de0e-ae5c-4934-b4f3-afd080cc8f6b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:41.604909 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c841de0e-ae5c-4934-b4f3-afd080cc8f6b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.186879 Jul 28 06:38:41.605774 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 104/211] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:41 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:42.631545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8075bad8-88f6-4123-acb4-59dad96832f8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:42.632846 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8075bad8-88f6-4123-acb4-59dad96832f8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:42.640539 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8075bad8-88f6-4123-acb4-59dad96832f8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:42.641322 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8075bad8-88f6-4123-acb4-59dad96832f8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:42.642448 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8075bad8-88f6-4123-acb4-59dad96832f8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:42.643097 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8075bad8-88f6-4123-acb4-59dad96832f8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:42.823757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8075bad8-88f6-4123-acb4-59dad96832f8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:42.835445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8075bad8-88f6-4123-acb4-59dad96832f8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.208580 Jul 28 06:38:42.869051 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 108/212] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:42 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:43.880159 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ea0c7438-ae2c-43ec-9091-b912f82c981d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:43.880968 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ea0c7438-ae2c-43ec-9091-b912f82c981d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:43.897667 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:43.899444 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ea0c7438-ae2c-43ec-9091-b912f82c981d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:43.899924 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ea0c7438-ae2c-43ec-9091-b912f82c981d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:43.900722 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ea0c7438-ae2c-43ec-9091-b912f82c981d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:43.901159 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ea0c7438-ae2c-43ec-9091-b912f82c981d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:44.118610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ea0c7438-ae2c-43ec-9091-b912f82c981d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:44.129428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ea0c7438-ae2c-43ec-9091-b912f82c981d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.255585 Jul 28 06:38:44.130465 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 105/213] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:43 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:45.151600 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4afb47ce-e576-443a-8b29-47ab704b3c9c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:45.152278 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4afb47ce-e576-443a-8b29-47ab704b3c9c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:45.155247 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=52 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:45.165476 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4afb47ce-e576-443a-8b29-47ab704b3c9c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:45.165946 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4afb47ce-e576-443a-8b29-47ab704b3c9c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:45.166723 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4afb47ce-e576-443a-8b29-47ab704b3c9c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:45.167172 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4afb47ce-e576-443a-8b29-47ab704b3c9c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:45.462637 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4afb47ce-e576-443a-8b29-47ab704b3c9c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:45.471528 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4afb47ce-e576-443a-8b29-47ab704b3c9c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.324019 Jul 28 06:38:45.473060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 109/214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:45 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:46.212151 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-805d50be-5a70-4af3-a7e4-e2de44f5da48 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:46.212774 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-805d50be-5a70-4af3-a7e4-e2de44f5da48 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:46.230121 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-805d50be-5a70-4af3-a7e4-e2de44f5da48 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:46.230794 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-805d50be-5a70-4af3-a7e4-e2de44f5da48 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:46.232329 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-805d50be-5a70-4af3-a7e4-e2de44f5da48 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:46.235489 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-805d50be-5a70-4af3-a7e4-e2de44f5da48 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:46.289107 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-805d50be-5a70-4af3-a7e4-e2de44f5da48 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] HTTP exception thrown: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-805d50be-5a70-4af3-a7e4-e2de44f5da48 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Request method failure captured: Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 HTTP/1.1 Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6hY1XgJFO7FdmuMfdFKElGh-mCTL-Xn07JRj4jAyBwIZ9eEVwYKStSIODftqh9A9-Dx5DPOobC-ob7uRCdRlwdeoUQDqY5_MJn_MbQuunhClAAGKVNj1yYArjLSQ4vKnU4FQiiKxTmwQVYd5QCI2viLzk0z6qrU85y0f-VbJcvR34 Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: a0e7a5dae78a4c10926c6fb66458c71b Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:38:46.303834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0e7a5dae78a4c10926c6fb66458c71b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0e7a5dae78a4c10926c6fb66458c71b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0e7a5dae78a4c10926c6fb66458c71b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0e7a5dae78a4c10926c6fb66458c71b"}]}] Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: a0e7a5dae78a4c10926c6fb66458c71b Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-DeleteServersTestJSON-655935377-project Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: b240f68acc734bd492843ad4ac35807c Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-DeleteServersTestJSON-655935377-project Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:46.305401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '6b1897c3-cdbe-4796-972b-29758824f972'} Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:38:46.306214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:46.308034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:38:46.309912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-805d50be-5a70-4af3-a7e4-e2de44f5da48 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Returning 404 to user: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:38:46.309912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-805d50be-5a70-4af3-a7e4-e2de44f5da48 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 404 len: 111 microversion: 2.1 time: 0.097757 Jul 28 06:38:46.309912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 106/215] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:38:46 2022] DELETE /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:38:46.319504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9106064b-5e4d-4f58-bde5-00bba3e6fb10 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:46.320131 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9106064b-5e4d-4f58-bde5-00bba3e6fb10 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] [instance: 6b1897c3-cdbe-4796-972b-29758824f972] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:46.327060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9106064b-5e4d-4f58-bde5-00bba3e6fb10 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:46.327513 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9106064b-5e4d-4f58-bde5-00bba3e6fb10 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:46.328291 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9106064b-5e4d-4f58-bde5-00bba3e6fb10 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:46.328724 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9106064b-5e4d-4f58-bde5-00bba3e6fb10 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:46.344990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-9106064b-5e4d-4f58-bde5-00bba3e6fb10 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] HTTP exception thrown: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9106064b-5e4d-4f58-bde5-00bba3e6fb10 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Request method failure captured: Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 HTTP/1.1 Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6hY1XgJFO7FdmuMfdFKElGh-mCTL-Xn07JRj4jAyBwIZ9eEVwYKStSIODftqh9A9-Dx5DPOobC-ob7uRCdRlwdeoUQDqY5_MJn_MbQuunhClAAGKVNj1yYArjLSQ4vKnU4FQiiKxTmwQVYd5QCI2viLzk0z6qrU85y0f-VbJcvR34 Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: a0e7a5dae78a4c10926c6fb66458c71b Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:38:46.347012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0e7a5dae78a4c10926c6fb66458c71b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0e7a5dae78a4c10926c6fb66458c71b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0e7a5dae78a4c10926c6fb66458c71b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0e7a5dae78a4c10926c6fb66458c71b"}]}] Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: a0e7a5dae78a4c10926c6fb66458c71b Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-DeleteServersTestJSON-655935377 Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-DeleteServersTestJSON-655935377-project Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: b240f68acc734bd492843ad4ac35807c Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-DeleteServersTestJSON-655935377-project Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:46.348498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '6b1897c3-cdbe-4796-972b-29758824f972'} Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:38:46.349315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. Jul 28 06:38:46.350621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:38:46.353130 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9106064b-5e4d-4f58-bde5-00bba3e6fb10 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] Returning 404 to user: Instance 6b1897c3-cdbe-4796-972b-29758824f972 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:38:46.354278 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9106064b-5e4d-4f58-bde5-00bba3e6fb10 tempest-DeleteServersTestJSON-655935377 tempest-DeleteServersTestJSON-655935377-project] 10.222.0.20 "GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972" status: 404 len: 111 microversion: 2.1 time: 0.043898 Jul 28 06:38:46.355929 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 110/216] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:46 2022] GET /compute/v2.1/servers/6b1897c3-cdbe-4796-972b-29758824f972 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:38:46.496705 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e3183015-e7f0-44fa-b2d8-c62d1847f1f5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:46.497373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e3183015-e7f0-44fa-b2d8-c62d1847f1f5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:46.515676 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e3183015-e7f0-44fa-b2d8-c62d1847f1f5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:46.516569 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e3183015-e7f0-44fa-b2d8-c62d1847f1f5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:46.517644 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e3183015-e7f0-44fa-b2d8-c62d1847f1f5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:46.526334 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e3183015-e7f0-44fa-b2d8-c62d1847f1f5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:46.814259 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e3183015-e7f0-44fa-b2d8-c62d1847f1f5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:46.826152 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e3183015-e7f0-44fa-b2d8-c62d1847f1f5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.333544 Jul 28 06:38:46.827304 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 107/217] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:46 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:47.856056 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d9f0bb5a-bab1-415b-b178-192afe133051 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:47.856674 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d9f0bb5a-bab1-415b-b178-192afe133051 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:47.871226 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9f0bb5a-bab1-415b-b178-192afe133051 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:47.871692 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9f0bb5a-bab1-415b-b178-192afe133051 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:47.872586 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9f0bb5a-bab1-415b-b178-192afe133051 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:47.873030 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9f0bb5a-bab1-415b-b178-192afe133051 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:48.202789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d9f0bb5a-bab1-415b-b178-192afe133051 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:48.211706 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d9f0bb5a-bab1-415b-b178-192afe133051 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.359357 Jul 28 06:38:48.219554 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 111/218] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:47 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:49.235369 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3a59cd74-cf35-4d0b-8ef0-411290330860 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:49.236054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3a59cd74-cf35-4d0b-8ef0-411290330860 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:49.242278 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3a59cd74-cf35-4d0b-8ef0-411290330860 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:49.243058 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3a59cd74-cf35-4d0b-8ef0-411290330860 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:49.244048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3a59cd74-cf35-4d0b-8ef0-411290330860 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:49.244705 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3a59cd74-cf35-4d0b-8ef0-411290330860 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:49.714976 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3a59cd74-cf35-4d0b-8ef0-411290330860 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:49.728502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3a59cd74-cf35-4d0b-8ef0-411290330860 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.496865 Jul 28 06:38:49.732769 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 108/219] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:49 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:50.754021 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-48c98c45-56b6-449a-9ead-8346f2f6af34 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:50.754631 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-48c98c45-56b6-449a-9ead-8346f2f6af34 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:50.765240 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-48c98c45-56b6-449a-9ead-8346f2f6af34 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:50.765815 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-48c98c45-56b6-449a-9ead-8346f2f6af34 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:50.766699 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-48c98c45-56b6-449a-9ead-8346f2f6af34 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:50.767274 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-48c98c45-56b6-449a-9ead-8346f2f6af34 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:51.379262 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-48c98c45-56b6-449a-9ead-8346f2f6af34 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:51.395218 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-48c98c45-56b6-449a-9ead-8346f2f6af34 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.645346 Jul 28 06:38:51.395833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 112/220] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:50 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:52.420779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-09dc25ec-f60d-4439-8a16-469808deb51a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:52.422003 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-09dc25ec-f60d-4439-8a16-469808deb51a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:52.431367 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-09dc25ec-f60d-4439-8a16-469808deb51a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:52.442076 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-09dc25ec-f60d-4439-8a16-469808deb51a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:52.442926 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-09dc25ec-f60d-4439-8a16-469808deb51a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:52.443375 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-09dc25ec-f60d-4439-8a16-469808deb51a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:52.752391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-09dc25ec-f60d-4439-8a16-469808deb51a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:52.763705 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-09dc25ec-f60d-4439-8a16-469808deb51a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.349119 Jul 28 06:38:52.765721 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 109/221] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:52 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:53.799434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5877f590-e7c5-4cd2-9a3f-c9654b636536 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:53.800845 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5877f590-e7c5-4cd2-9a3f-c9654b636536 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:53.819730 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5877f590-e7c5-4cd2-9a3f-c9654b636536 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:53.820722 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5877f590-e7c5-4cd2-9a3f-c9654b636536 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:53.823896 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5877f590-e7c5-4cd2-9a3f-c9654b636536 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:53.824772 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5877f590-e7c5-4cd2-9a3f-c9654b636536 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:54.161879 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5877f590-e7c5-4cd2-9a3f-c9654b636536 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:54.172830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5877f590-e7c5-4cd2-9a3f-c9654b636536 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.389831 Jul 28 06:38:54.175567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 113/222] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:53 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:55.199210 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d46513fc-fa36-4038-a8ce-88e716587348 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:55.201005 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d46513fc-fa36-4038-a8ce-88e716587348 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:55.225805 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d46513fc-fa36-4038-a8ce-88e716587348 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:55.228682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d46513fc-fa36-4038-a8ce-88e716587348 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:55.230440 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d46513fc-fa36-4038-a8ce-88e716587348 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:55.232414 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d46513fc-fa36-4038-a8ce-88e716587348 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:55.567744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d46513fc-fa36-4038-a8ce-88e716587348 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:55.579285 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d46513fc-fa36-4038-a8ce-88e716587348 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.386390 Jul 28 06:38:55.579906 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 110/223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:55 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:55.946020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a5ddfa32-b116-4a93-9090-ab8a9e04e053 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Action: 'create', calling method: .version_select at 0x7f574c0b5c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-306828582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcfj+XXauYA/ciYeIC+OITG3Q+rYOmjfp0j6+oVI7FV6PYx0HzWqMUYmJy9yiiw4SPvmoqGYaVnlc8PA00J14n9kVLmnTmGcipk9zzHxmp+Hr9y89eJm5Ov6jdlb3wvSQ=="}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:55.973045 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-a5ddfa32-b116-4a93-9090-ab8a9e04e053 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Getting quotas for project f16eee0fb716452e8c760a27b5724d91. Resources: {'key_pairs'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:38:55.977411 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-a5ddfa32-b116-4a93-9090-ab8a9e04e053 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Getting quotas for user 13ca4be686f84c279f87016c20129833 and project f16eee0fb716452e8c760a27b5724d91. Resources: {'key_pairs'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:38:56.034606 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a5ddfa32-b116-4a93-9090-ab8a9e04e053 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.463081 Jul 28 06:38:56.036433 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 114/224] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Jul 28 06:38:55 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:38:56.602750 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f3a2d416-0754-4164-b7e2-f530ee5d400b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:56.604154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f3a2d416-0754-4164-b7e2-f530ee5d400b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:56.613410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3a2d416-0754-4164-b7e2-f530ee5d400b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:56.614234 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3a2d416-0754-4164-b7e2-f530ee5d400b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:56.616966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3a2d416-0754-4164-b7e2-f530ee5d400b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:56.617678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3a2d416-0754-4164-b7e2-f530ee5d400b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:56.904388 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f3a2d416-0754-4164-b7e2-f530ee5d400b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:56.915473 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f3a2d416-0754-4164-b7e2-f530ee5d400b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.317813 Jul 28 06:38:56.917125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 111/225] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:56 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:57.941326 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-77f58fac-0295-48eb-af5f-c4a07a79872b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:57.941961 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-77f58fac-0295-48eb-af5f-c4a07a79872b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:57.961119 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77f58fac-0295-48eb-af5f-c4a07a79872b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:57.961609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77f58fac-0295-48eb-af5f-c4a07a79872b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:57.962422 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77f58fac-0295-48eb-af5f-c4a07a79872b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:57.962890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77f58fac-0295-48eb-af5f-c4a07a79872b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:58.132424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-77f58fac-0295-48eb-af5f-c4a07a79872b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:58.142143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-77f58fac-0295-48eb-af5f-c4a07a79872b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.205792 Jul 28 06:38:58.142788 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 115/226] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:57 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:59.163487 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b7228a48-2092-4f8f-8e02-d4e7f0d0439c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:59.164105 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b7228a48-2092-4f8f-8e02-d4e7f0d0439c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:59.173016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7228a48-2092-4f8f-8e02-d4e7f0d0439c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:59.173553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7228a48-2092-4f8f-8e02-d4e7f0d0439c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:59.174378 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7228a48-2092-4f8f-8e02-d4e7f0d0439c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:59.177624 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7228a48-2092-4f8f-8e02-d4e7f0d0439c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:59.529165 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b7228a48-2092-4f8f-8e02-d4e7f0d0439c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:59.536987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b7228a48-2092-4f8f-8e02-d4e7f0d0439c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.377560 Jul 28 06:38:59.537597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 112/227] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:59 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:00.575540 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-be70edfe-0557-4bf4-b5bd-e73353ae42a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:00.576356 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-be70edfe-0557-4bf4-b5bd-e73353ae42a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:00.590393 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-be70edfe-0557-4bf4-b5bd-e73353ae42a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:00.594621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-be70edfe-0557-4bf4-b5bd-e73353ae42a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:00.597973 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-be70edfe-0557-4bf4-b5bd-e73353ae42a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:00.599329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-be70edfe-0557-4bf4-b5bd-e73353ae42a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:00.813742 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-be70edfe-0557-4bf4-b5bd-e73353ae42a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:00.823743 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-be70edfe-0557-4bf4-b5bd-e73353ae42a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.265486 Jul 28 06:39:00.824340 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 116/228] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:00 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:01.616916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1761518563", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "networks": [{"uuid": "68f02050-09bf-429b-8750-a014c7a2dad3"}]}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:01.714899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.network.neutron [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] validate_networks() for [('68f02050-09bf-429b-8750-a014c7a2dad3', None, None, None, None, None)] {{(pid=124562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:39:01.853106 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-21859830-afa6-432a-8481-f80c17754eb9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:01.855430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-21859830-afa6-432a-8481-f80c17754eb9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:01.875884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-21859830-afa6-432a-8481-f80c17754eb9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:01.876532 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-21859830-afa6-432a-8481-f80c17754eb9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:01.878752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-21859830-afa6-432a-8481-f80c17754eb9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:01.879432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-21859830-afa6-432a-8481-f80c17754eb9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:02.128540 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-21859830-afa6-432a-8481-f80c17754eb9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:02.137680 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-21859830-afa6-432a-8481-f80c17754eb9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.295773 Jul 28 06:39:02.138534 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 117/229] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:01 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:02.240034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Flavor limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:39:02.240369 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Image limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:39:02.240846 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Flavor pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:39:02.241258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Image pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:39:02.241717 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:39:02.251938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:02.252989 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:02.254060 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:02.254931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:02.274704 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Getting quotas for project 57601f159e244aa68924602c2c5dc385. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:39:02.281931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Getting quotas for user ffc6812703254c51a4200abf3dee2d95 and project 57601f159e244aa68924602c2c5dc385. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:39:02.296011 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Going to run 1 instances... {{(pid=124562) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:39:02.298862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:39:02.363646 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6eb9bd71-fd69-49d6-ae6e-c807b44b3bb6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752262 Jul 28 06:39:02.364662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 113/230] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:39:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:39:02.377331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0e8e6361-56f9-4bd1-ae7a-2bb083480c7f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:02.378628 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0e8e6361-56f9-4bd1-ae7a-2bb083480c7f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:02.482085 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0e8e6361-56f9-4bd1-ae7a-2bb083480c7f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:02.502168 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0e8e6361-56f9-4bd1-ae7a-2bb083480c7f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1214 microversion: 2.1 time: 0.128299 Jul 28 06:39:02.503525 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 118/231] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:02 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:03.158403 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-50e81c22-115b-4e84-aecc-39a4affb0313 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:03.160171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-50e81c22-115b-4e84-aecc-39a4affb0313 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:03.166249 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-50e81c22-115b-4e84-aecc-39a4affb0313 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:03.166788 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-50e81c22-115b-4e84-aecc-39a4affb0313 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:03.167644 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-50e81c22-115b-4e84-aecc-39a4affb0313 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:03.168085 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-50e81c22-115b-4e84-aecc-39a4affb0313 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:03.357535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-50e81c22-115b-4e84-aecc-39a4affb0313 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:03.370642 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-50e81c22-115b-4e84-aecc-39a4affb0313 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.216541 Jul 28 06:39:03.374018 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 114/232] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:03 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:03.525055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-868dc80f-a690-43fe-b539-c59128228643 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:03.526271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-868dc80f-a690-43fe-b539-c59128228643 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:03.533944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-868dc80f-a690-43fe-b539-c59128228643 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:03.534984 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-868dc80f-a690-43fe-b539-c59128228643 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:03.535987 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-868dc80f-a690-43fe-b539-c59128228643 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:03.536422 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-868dc80f-a690-43fe-b539-c59128228643 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:03.615113 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-868dc80f-a690-43fe-b539-c59128228643 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:03.622881 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-868dc80f-a690-43fe-b539-c59128228643 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1210 microversion: 2.1 time: 0.101708 Jul 28 06:39:03.623743 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 119/233] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:03 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:04.397570 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-278e8b17-48b8-4956-9b6d-00243a637ed1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:04.398195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-278e8b17-48b8-4956-9b6d-00243a637ed1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:04.417434 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-278e8b17-48b8-4956-9b6d-00243a637ed1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:04.417789 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-278e8b17-48b8-4956-9b6d-00243a637ed1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:04.418660 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-278e8b17-48b8-4956-9b6d-00243a637ed1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:04.431199 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-278e8b17-48b8-4956-9b6d-00243a637ed1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:04.653227 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-81ee8a04-7937-4e0b-97c6-536dc3af8c8b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:04.657261 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-81ee8a04-7937-4e0b-97c6-536dc3af8c8b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:04.673584 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-278e8b17-48b8-4956-9b6d-00243a637ed1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:04.682303 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81ee8a04-7937-4e0b-97c6-536dc3af8c8b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:04.683070 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81ee8a04-7937-4e0b-97c6-536dc3af8c8b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:04.684313 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81ee8a04-7937-4e0b-97c6-536dc3af8c8b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:04.684968 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81ee8a04-7937-4e0b-97c6-536dc3af8c8b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:04.693647 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-278e8b17-48b8-4956-9b6d-00243a637ed1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1522 microversion: 2.1 time: 0.301051 Jul 28 06:39:04.699504 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 115/234] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:04 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:04.952781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-81ee8a04-7937-4e0b-97c6-536dc3af8c8b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:04.961648 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-81ee8a04-7937-4e0b-97c6-536dc3af8c8b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1274 microversion: 2.1 time: 0.317309 Jul 28 06:39:04.963051 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 120/235] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:04 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1274 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:05.721416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-434ea637-828e-4c18-a586-9c69123cae4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:05.722427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-434ea637-828e-4c18-a586-9c69123cae4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:05.734793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-434ea637-828e-4c18-a586-9c69123cae4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:05.735347 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-434ea637-828e-4c18-a586-9c69123cae4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:05.737738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-434ea637-828e-4c18-a586-9c69123cae4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:05.738417 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-434ea637-828e-4c18-a586-9c69123cae4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:05.986447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-57846f44-f257-42ea-86c7-54305cd50ec8 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:05.987797 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-57846f44-f257-42ea-86c7-54305cd50ec8 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:06.007701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-57846f44-f257-42ea-86c7-54305cd50ec8 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:06.008143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-57846f44-f257-42ea-86c7-54305cd50ec8 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:06.008912 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-57846f44-f257-42ea-86c7-54305cd50ec8 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:06.009371 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-57846f44-f257-42ea-86c7-54305cd50ec8 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:06.098213 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-434ea637-828e-4c18-a586-9c69123cae4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:06.099903 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-57846f44-f257-42ea-86c7-54305cd50ec8 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:06.107078 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-434ea637-828e-4c18-a586-9c69123cae4b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1502 microversion: 2.1 time: 0.394822 Jul 28 06:39:06.108792 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-57846f44-f257-42ea-86c7-54305cd50ec8 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1272 microversion: 2.1 time: 0.125950 Jul 28 06:39:06.108958 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 116/236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:05 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:06.122299 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 121/237] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:05 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:06.131827 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ec6ad66e-e64c-49a7-b331-821a2c3a8d42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:06.132548 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ec6ad66e-e64c-49a7-b331-821a2c3a8d42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:06.142187 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ec6ad66e-e64c-49a7-b331-821a2c3a8d42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:06.143470 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ec6ad66e-e64c-49a7-b331-821a2c3a8d42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:06.145730 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ec6ad66e-e64c-49a7-b331-821a2c3a8d42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:06.146254 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ec6ad66e-e64c-49a7-b331-821a2c3a8d42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:06.714406 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ec6ad66e-e64c-49a7-b331-821a2c3a8d42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:06.731024 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ec6ad66e-e64c-49a7-b331-821a2c3a8d42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1515 microversion: 2.1 time: 0.605340 Jul 28 06:39:06.732563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 117/238] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:06 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1515 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:07.137186 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ca84a33a-c026-42fb-b2cd-d577f43c466c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:07.137938 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ca84a33a-c026-42fb-b2cd-d577f43c466c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:07.152865 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ca84a33a-c026-42fb-b2cd-d577f43c466c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:07.153212 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ca84a33a-c026-42fb-b2cd-d577f43c466c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:07.155551 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ca84a33a-c026-42fb-b2cd-d577f43c466c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:07.156028 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ca84a33a-c026-42fb-b2cd-d577f43c466c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:07.476979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ca84a33a-c026-42fb-b2cd-d577f43c466c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:07.485457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ca84a33a-c026-42fb-b2cd-d577f43c466c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1314 microversion: 2.1 time: 0.356165 Jul 28 06:39:07.486434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 122/239] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:07 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:08.039297 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-49665db3-d288-4aee-aee5-3ee485173e20 req-decda722-8d3f-4414-9d7c-76013fdb8442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d347e2-1f9f-4a20-96f0-ca175e3aacf5", "tag": "9887f65c-7b0a-4a46-b6a9-9573f2d30ab5"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:08.066928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-49665db3-d288-4aee-aee5-3ee485173e20 req-decda722-8d3f-4414-9d7c-76013fdb8442 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:08.067536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-49665db3-d288-4aee-aee5-3ee485173e20 req-decda722-8d3f-4414-9d7c-76013fdb8442 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:08.092345 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-49665db3-d288-4aee-aee5-3ee485173e20 req-decda722-8d3f-4414-9d7c-76013fdb8442 service nova] Creating event network-changed:9887f65c-7b0a-4a46-b6a9-9573f2d30ab5 for instance 39d347e2-1f9f-4a20-96f0-ca175e3aacf5 on hv-cinder-85060 Jul 28 06:39:08.098686 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-49665db3-d288-4aee-aee5-3ee485173e20 req-decda722-8d3f-4414-9d7c-76013fdb8442 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065431 Jul 28 06:39:08.099395 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 118/240] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:08.491662 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-63ae5e57-4327-4b59-957d-27cfe627bc15 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:08.494052 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-63ae5e57-4327-4b59-957d-27cfe627bc15 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:08.507560 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-63ae5e57-4327-4b59-957d-27cfe627bc15 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:08.508115 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-63ae5e57-4327-4b59-957d-27cfe627bc15 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:08.509030 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-63ae5e57-4327-4b59-957d-27cfe627bc15 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:08.509643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-63ae5e57-4327-4b59-957d-27cfe627bc15 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:08.511268 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-df755b1d-41c7-41d2-b1b1-88de3c02bdf2 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:08.512158 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-df755b1d-41c7-41d2-b1b1-88de3c02bdf2 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:08.512349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:08.519569 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-df755b1d-41c7-41d2-b1b1-88de3c02bdf2 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:08.520016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-df755b1d-41c7-41d2-b1b1-88de3c02bdf2 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:08.520812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-df755b1d-41c7-41d2-b1b1-88de3c02bdf2 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:08.521247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-df755b1d-41c7-41d2-b1b1-88de3c02bdf2 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:08.536178 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-63ae5e57-4327-4b59-957d-27cfe627bc15 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lazy-loading 'flavor' on Instance uuid 759d9d29-e67f-49e4-986a-5d71340fd0c3 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:39:08.663767 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-63ae5e57-4327-4b59-957d-27cfe627bc15 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3/action" status: 200 len: 32 microversion: 2.1 time: 0.176796 Jul 28 06:39:08.664771 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 123/241] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:39:08 2022] POST /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:39:08.675184 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1964c1de-d713-4b38-b63f-703035da20a6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:08.676134 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1964c1de-d713-4b38-b63f-703035da20a6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:08.683970 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1964c1de-d713-4b38-b63f-703035da20a6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:08.684758 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1964c1de-d713-4b38-b63f-703035da20a6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:08.685719 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1964c1de-d713-4b38-b63f-703035da20a6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:08.686429 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1964c1de-d713-4b38-b63f-703035da20a6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:08.693285 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-df755b1d-41c7-41d2-b1b1-88de3c02bdf2 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:08.704474 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-df755b1d-41c7-41d2-b1b1-88de3c02bdf2 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1314 microversion: 2.1 time: 0.198370 Jul 28 06:39:08.706068 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 119/242] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:08 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:08.842992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1964c1de-d713-4b38-b63f-703035da20a6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:08.851111 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1964c1de-d713-4b38-b63f-703035da20a6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.180356 Jul 28 06:39:08.851688 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 124/243] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:08 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:09.726267 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7a577b17-2e69-4129-9c37-663af38ef399 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:09.726976 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7a577b17-2e69-4129-9c37-663af38ef399 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:09.732862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a577b17-2e69-4129-9c37-663af38ef399 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:09.733326 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a577b17-2e69-4129-9c37-663af38ef399 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:09.734099 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a577b17-2e69-4129-9c37-663af38ef399 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:09.734529 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a577b17-2e69-4129-9c37-663af38ef399 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:09.874238 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7a577b17-2e69-4129-9c37-663af38ef399 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:09.881747 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dec0e2c5-a7ed-4cf4-9574-53729950f469 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:09.882434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-dec0e2c5-a7ed-4cf4-9574-53729950f469 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:09.882542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7a577b17-2e69-4129-9c37-663af38ef399 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1314 microversion: 2.1 time: 0.160058 Jul 28 06:39:09.883093 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 120/244] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:09 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:09.889443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dec0e2c5-a7ed-4cf4-9574-53729950f469 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:09.889884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dec0e2c5-a7ed-4cf4-9574-53729950f469 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:09.891691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dec0e2c5-a7ed-4cf4-9574-53729950f469 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:09.892350 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dec0e2c5-a7ed-4cf4-9574-53729950f469 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:10.044641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dec0e2c5-a7ed-4cf4-9574-53729950f469 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:10.058403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-dec0e2c5-a7ed-4cf4-9574-53729950f469 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.189606 Jul 28 06:39:10.059760 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 125/245] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:09 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:10.905275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-88523c29-cb56-4c18-8869-21c96721ecd3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:10.905874 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-88523c29-cb56-4c18-8869-21c96721ecd3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:10.912912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-88523c29-cb56-4c18-8869-21c96721ecd3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:10.913385 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-88523c29-cb56-4c18-8869-21c96721ecd3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:10.914164 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-88523c29-cb56-4c18-8869-21c96721ecd3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:10.914580 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-88523c29-cb56-4c18-8869-21c96721ecd3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:10.918691 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=93 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:11.081447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e8f8108b-ebf4-4d78-8b23-a1db463db9a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:11.082162 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e8f8108b-ebf4-4d78-8b23-a1db463db9a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:11.088883 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8f8108b-ebf4-4d78-8b23-a1db463db9a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:11.089617 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8f8108b-ebf4-4d78-8b23-a1db463db9a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:11.090585 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8f8108b-ebf4-4d78-8b23-a1db463db9a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:11.091257 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8f8108b-ebf4-4d78-8b23-a1db463db9a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:11.199601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-88523c29-cb56-4c18-8869-21c96721ecd3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:11.208131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-88523c29-cb56-4c18-8869-21c96721ecd3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1314 microversion: 2.1 time: 0.306703 Jul 28 06:39:11.209058 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 121/246] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:10 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:11.238985 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e8f8108b-ebf4-4d78-8b23-a1db463db9a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:11.246721 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e8f8108b-ebf4-4d78-8b23-a1db463db9a0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.170683 Jul 28 06:39:11.247363 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 126/247] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:11 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:12.230550 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b6aac97e-a47e-4821-b7de-56b610da4978 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:12.231519 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b6aac97e-a47e-4821-b7de-56b610da4978 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:12.238857 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b6aac97e-a47e-4821-b7de-56b610da4978 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:12.239305 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b6aac97e-a47e-4821-b7de-56b610da4978 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:12.240083 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b6aac97e-a47e-4821-b7de-56b610da4978 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:12.240519 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b6aac97e-a47e-4821-b7de-56b610da4978 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:12.265138 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:12.275749 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-cee4f44b-2725-427c-967f-5d8772a83119 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:12.277533 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-cee4f44b-2725-427c-967f-5d8772a83119 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:12.285586 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cee4f44b-2725-427c-967f-5d8772a83119 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:12.286126 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cee4f44b-2725-427c-967f-5d8772a83119 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:12.287466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cee4f44b-2725-427c-967f-5d8772a83119 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:12.288055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cee4f44b-2725-427c-967f-5d8772a83119 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:12.293650 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=6 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:12.419294 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b6aac97e-a47e-4821-b7de-56b610da4978 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:12.439906 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b6aac97e-a47e-4821-b7de-56b610da4978 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1314 microversion: 2.1 time: 0.214358 Jul 28 06:39:12.440725 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 122/248] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:12 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:12.501009 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=6 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:12.506862 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-cee4f44b-2725-427c-967f-5d8772a83119 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:12.519566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-cee4f44b-2725-427c-967f-5d8772a83119 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.253340 Jul 28 06:39:12.520952 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 127/249] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:12 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:13.460685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b1257c48-c7e2-4dbb-999b-29e6c48b3fa9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:13.461325 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b1257c48-c7e2-4dbb-999b-29e6c48b3fa9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:13.474144 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b1257c48-c7e2-4dbb-999b-29e6c48b3fa9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:13.475516 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b1257c48-c7e2-4dbb-999b-29e6c48b3fa9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:13.476650 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b1257c48-c7e2-4dbb-999b-29e6c48b3fa9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:13.477363 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b1257c48-c7e2-4dbb-999b-29e6c48b3fa9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:13.541995 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-71f2b637-eaf2-466c-9331-564124acf7c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:13.542722 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-71f2b637-eaf2-466c-9331-564124acf7c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:13.550823 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71f2b637-eaf2-466c-9331-564124acf7c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:13.553025 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71f2b637-eaf2-466c-9331-564124acf7c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:13.555438 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71f2b637-eaf2-466c-9331-564124acf7c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:13.556336 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71f2b637-eaf2-466c-9331-564124acf7c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:13.675194 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b1257c48-c7e2-4dbb-999b-29e6c48b3fa9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:13.689888 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b1257c48-c7e2-4dbb-999b-29e6c48b3fa9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1314 microversion: 2.1 time: 0.233566 Jul 28 06:39:13.690535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 123/250] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:13 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:13.821867 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-71f2b637-eaf2-466c-9331-564124acf7c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:13.830789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-71f2b637-eaf2-466c-9331-564124acf7c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.292574 Jul 28 06:39:13.831379 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 128/251] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:13 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:14.711576 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7f747ba3-280e-4654-af43-50af4a4d0f7d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:14.712372 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7f747ba3-280e-4654-af43-50af4a4d0f7d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:14.714555 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:14.723257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7f747ba3-280e-4654-af43-50af4a4d0f7d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:14.723882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7f747ba3-280e-4654-af43-50af4a4d0f7d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:14.725110 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7f747ba3-280e-4654-af43-50af4a4d0f7d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:14.726498 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7f747ba3-280e-4654-af43-50af4a4d0f7d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:14.854395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e0816ed6-f316-4a45-b897-094be1472855 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:14.855807 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e0816ed6-f316-4a45-b897-094be1472855 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:14.871100 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e0816ed6-f316-4a45-b897-094be1472855 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:14.871959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e0816ed6-f316-4a45-b897-094be1472855 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:14.873590 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e0816ed6-f316-4a45-b897-094be1472855 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:14.874183 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e0816ed6-f316-4a45-b897-094be1472855 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:14.925441 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7f747ba3-280e-4654-af43-50af4a4d0f7d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:14.933944 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7f747ba3-280e-4654-af43-50af4a4d0f7d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1314 microversion: 2.1 time: 0.226461 Jul 28 06:39:14.934517 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 124/252] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:14 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:15.104161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e0816ed6-f316-4a45-b897-094be1472855 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:15.146068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e0816ed6-f316-4a45-b897-094be1472855 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.296739 Jul 28 06:39:15.147777 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 129/253] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:14 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:15.300034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-ac1ef8b3-b59b-4860-a60a-57f13cbc0c8e req-9195b9b6-020c-4085-9648-ab7c039b93f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d347e2-1f9f-4a20-96f0-ca175e3aacf5", "name": "network-vif-plugged", "status": "completed", "tag": "9887f65c-7b0a-4a46-b6a9-9573f2d30ab5"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:15.317579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-ac1ef8b3-b59b-4860-a60a-57f13cbc0c8e req-9195b9b6-020c-4085-9648-ab7c039b93f5 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:15.318032 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-ac1ef8b3-b59b-4860-a60a-57f13cbc0c8e req-9195b9b6-020c-4085-9648-ab7c039b93f5 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:15.344795 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-ac1ef8b3-b59b-4860-a60a-57f13cbc0c8e req-9195b9b6-020c-4085-9648-ab7c039b93f5 service nova] Creating event network-vif-plugged:9887f65c-7b0a-4a46-b6a9-9573f2d30ab5 for instance 39d347e2-1f9f-4a20-96f0-ca175e3aacf5 on hv-cinder-85060 Jul 28 06:39:15.358344 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-ac1ef8b3-b59b-4860-a60a-57f13cbc0c8e req-9195b9b6-020c-4085-9648-ab7c039b93f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063117 Jul 28 06:39:15.361097 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 125/254] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:15.959419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-632c2a7f-8848-498b-ab6b-39966d04f69d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:15.960106 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-632c2a7f-8848-498b-ab6b-39966d04f69d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:15.964013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:15.968199 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-632c2a7f-8848-498b-ab6b-39966d04f69d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:15.968697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-632c2a7f-8848-498b-ab6b-39966d04f69d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:15.969840 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-632c2a7f-8848-498b-ab6b-39966d04f69d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:15.970518 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-632c2a7f-8848-498b-ab6b-39966d04f69d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:16.171643 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-87952c9d-84fd-49a5-8439-522f50a0888b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:16.172868 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-87952c9d-84fd-49a5-8439-522f50a0888b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:16.181837 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87952c9d-84fd-49a5-8439-522f50a0888b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:16.182433 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87952c9d-84fd-49a5-8439-522f50a0888b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:16.183226 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87952c9d-84fd-49a5-8439-522f50a0888b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:16.183903 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-87952c9d-84fd-49a5-8439-522f50a0888b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:16.221376 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-632c2a7f-8848-498b-ab6b-39966d04f69d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:16.232565 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-632c2a7f-8848-498b-ab6b-39966d04f69d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1314 microversion: 2.1 time: 0.277707 Jul 28 06:39:16.233331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 130/255] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:15 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:16.366255 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-87952c9d-84fd-49a5-8439-522f50a0888b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:16.375776 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-87952c9d-84fd-49a5-8439-522f50a0888b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.210105 Jul 28 06:39:16.376352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 126/256] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:16 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:17.257426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-fdf40f36-a57a-4315-8492-87786341be49 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:17.258809 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-fdf40f36-a57a-4315-8492-87786341be49 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:17.265855 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fdf40f36-a57a-4315-8492-87786341be49 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:17.266352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fdf40f36-a57a-4315-8492-87786341be49 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:17.267147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fdf40f36-a57a-4315-8492-87786341be49 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:17.267653 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fdf40f36-a57a-4315-8492-87786341be49 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:17.398380 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9f4ff860-d54e-49a3-84c0-2e89e1ae0826 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:17.400396 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9f4ff860-d54e-49a3-84c0-2e89e1ae0826 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:17.409827 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f4ff860-d54e-49a3-84c0-2e89e1ae0826 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:17.410870 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f4ff860-d54e-49a3-84c0-2e89e1ae0826 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:17.418574 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f4ff860-d54e-49a3-84c0-2e89e1ae0826 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:17.419352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f4ff860-d54e-49a3-84c0-2e89e1ae0826 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:17.490503 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-fdf40f36-a57a-4315-8492-87786341be49 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:17.504914 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-fdf40f36-a57a-4315-8492-87786341be49 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1314 microversion: 2.1 time: 0.253693 Jul 28 06:39:17.506201 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 131/257] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:17 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:17.614512 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9f4ff860-d54e-49a3-84c0-2e89e1ae0826 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:17.625288 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9f4ff860-d54e-49a3-84c0-2e89e1ae0826 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.233018 Jul 28 06:39:17.625973 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 127/258] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:17 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:18.526648 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-cf1954c3-4f51-4d42-83d5-35af753aa5e6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:18.527378 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-cf1954c3-4f51-4d42-83d5-35af753aa5e6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:18.538760 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf1954c3-4f51-4d42-83d5-35af753aa5e6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:18.541700 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf1954c3-4f51-4d42-83d5-35af753aa5e6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:18.542678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf1954c3-4f51-4d42-83d5-35af753aa5e6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:18.544752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cf1954c3-4f51-4d42-83d5-35af753aa5e6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:18.648835 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-446915cf-7cff-4c83-8fa8-6996944cf9e3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:18.649472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-446915cf-7cff-4c83-8fa8-6996944cf9e3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:18.663636 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-446915cf-7cff-4c83-8fa8-6996944cf9e3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:18.664092 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-446915cf-7cff-4c83-8fa8-6996944cf9e3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:18.664866 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-446915cf-7cff-4c83-8fa8-6996944cf9e3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:18.665334 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-446915cf-7cff-4c83-8fa8-6996944cf9e3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:18.863022 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-cf1954c3-4f51-4d42-83d5-35af753aa5e6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:18.873161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-cf1954c3-4f51-4d42-83d5-35af753aa5e6 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1314 microversion: 2.1 time: 0.350667 Jul 28 06:39:18.874451 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 132/259] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:18 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:18.978328 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-446915cf-7cff-4c83-8fa8-6996944cf9e3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:18.989425 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-446915cf-7cff-4c83-8fa8-6996944cf9e3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.345399 Jul 28 06:39:19.005142 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 128/260] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:18 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:19.895905 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2639b1e5-ee3a-469d-9d2f-0e1c13b2edcb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:19.896521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2639b1e5-ee3a-469d-9d2f-0e1c13b2edcb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:19.908515 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2639b1e5-ee3a-469d-9d2f-0e1c13b2edcb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:19.909027 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2639b1e5-ee3a-469d-9d2f-0e1c13b2edcb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:19.909875 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2639b1e5-ee3a-469d-9d2f-0e1c13b2edcb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:19.910313 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2639b1e5-ee3a-469d-9d2f-0e1c13b2edcb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:20.010621 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2a77e560-d985-453e-aab8-65b2f64fec31 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:20.012145 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2a77e560-d985-453e-aab8-65b2f64fec31 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:20.026487 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2a77e560-d985-453e-aab8-65b2f64fec31 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:20.027174 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2a77e560-d985-453e-aab8-65b2f64fec31 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:20.031678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2a77e560-d985-453e-aab8-65b2f64fec31 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:20.032262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2a77e560-d985-453e-aab8-65b2f64fec31 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:20.273063 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2639b1e5-ee3a-469d-9d2f-0e1c13b2edcb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:20.303791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2639b1e5-ee3a-469d-9d2f-0e1c13b2edcb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1498 microversion: 2.1 time: 0.412467 Jul 28 06:39:20.307569 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 133/261] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:19 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1498 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:20.403223 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2a77e560-d985-453e-aab8-65b2f64fec31 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:20.418195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2a77e560-d985-453e-aab8-65b2f64fec31 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.411381 Jul 28 06:39:20.449427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 129/262] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:20 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:21.445954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-185a646c-ce3d-415f-99b1-861c9c833e85 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:21.447082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-185a646c-ce3d-415f-99b1-861c9c833e85 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:21.469497 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-185a646c-ce3d-415f-99b1-861c9c833e85 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:21.470003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-185a646c-ce3d-415f-99b1-861c9c833e85 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:21.475645 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-185a646c-ce3d-415f-99b1-861c9c833e85 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:21.476111 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-185a646c-ce3d-415f-99b1-861c9c833e85 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:21.793882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7901d879-203f-4721-a881-bdcc24709f6c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:21.794565 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7901d879-203f-4721-a881-bdcc24709f6c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:21.807493 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7901d879-203f-4721-a881-bdcc24709f6c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:21.808243 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7901d879-203f-4721-a881-bdcc24709f6c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:21.813402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7901d879-203f-4721-a881-bdcc24709f6c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:21.815008 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7901d879-203f-4721-a881-bdcc24709f6c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:21.865848 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7901d879-203f-4721-a881-bdcc24709f6c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:39:21.926206 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-185a646c-ce3d-415f-99b1-861c9c833e85 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:21.934551 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-185a646c-ce3d-415f-99b1-861c9c833e85 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.493352 Jul 28 06:39:21.935124 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 134/263] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:21 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:22.008813 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7901d879-203f-4721-a881-bdcc24709f6c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 204 len: 0 microversion: 2.1 time: 0.223914 Jul 28 06:39:22.009995 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 130/264] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:39:21 2022] DELETE /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:39:22.019658 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e373c637-f271-41e9-8fa1-3f841d7579df tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:22.020345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e373c637-f271-41e9-8fa1-3f841d7579df tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:22.032548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e373c637-f271-41e9-8fa1-3f841d7579df tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:22.035151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e373c637-f271-41e9-8fa1-3f841d7579df tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:22.036511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e373c637-f271-41e9-8fa1-3f841d7579df tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:22.037457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e373c637-f271-41e9-8fa1-3f841d7579df tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:22.430191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e373c637-f271-41e9-8fa1-3f841d7579df tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:22.460756 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e373c637-f271-41e9-8fa1-3f841d7579df tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1504 microversion: 2.1 time: 0.446137 Jul 28 06:39:22.461654 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 135/265] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:22 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:22.957254 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-fb1248b0-b6ae-4b36-87a9-30237a5d4805 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:22.958620 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-fb1248b0-b6ae-4b36-87a9-30237a5d4805 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:22.965282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fb1248b0-b6ae-4b36-87a9-30237a5d4805 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:22.965977 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fb1248b0-b6ae-4b36-87a9-30237a5d4805 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:22.966917 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fb1248b0-b6ae-4b36-87a9-30237a5d4805 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:22.967509 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fb1248b0-b6ae-4b36-87a9-30237a5d4805 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:23.217712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-fb1248b0-b6ae-4b36-87a9-30237a5d4805 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:23.234009 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-fb1248b0-b6ae-4b36-87a9-30237a5d4805 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.279949 Jul 28 06:39:23.241562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 131/266] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:22 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:23.488513 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b9d1812b-c88f-47d8-ab7e-20807f81bbbe tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:23.491598 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b9d1812b-c88f-47d8-ab7e-20807f81bbbe tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:23.531443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9d1812b-c88f-47d8-ab7e-20807f81bbbe tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:23.531907 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9d1812b-c88f-47d8-ab7e-20807f81bbbe tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:23.532713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9d1812b-c88f-47d8-ab7e-20807f81bbbe tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:23.551904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9d1812b-c88f-47d8-ab7e-20807f81bbbe tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:23.635382 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-818097710", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "networks": [{"uuid": "c3ce7e55-3e64-4d32-b695-8bbb88b7772d"}]}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:23.796753 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.network.neutron [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] validate_networks() for [('c3ce7e55-3e64-4d32-b695-8bbb88b7772d', None, None, None, None, None)] {{(pid=124562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:39:23.892339 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b9d1812b-c88f-47d8-ab7e-20807f81bbbe tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:23.905530 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b9d1812b-c88f-47d8-ab7e-20807f81bbbe tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1504 microversion: 2.1 time: 0.418367 Jul 28 06:39:23.906658 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 136/267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:23 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:24.124022 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ce75eab7-b4cc-451f-9140-3b35c4cdad88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:24.124022 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ce75eab7-b4cc-451f-9140-3b35c4cdad88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:24.138153 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce75eab7-b4cc-451f-9140-3b35c4cdad88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:24.144763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce75eab7-b4cc-451f-9140-3b35c4cdad88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:24.148920 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce75eab7-b4cc-451f-9140-3b35c4cdad88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:24.150663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce75eab7-b4cc-451f-9140-3b35c4cdad88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:24.180514 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ce75eab7-b4cc-451f-9140-3b35c4cdad88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/ips" status: 200 len: 151 microversion: 2.20 time: 0.065032 Jul 28 06:39:24.181283 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 137/268] 10.222.0.20 () {60 vars in 1289 bytes} [Thu Jul 28 06:39:24 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/ips => generated 151 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:39:24.259661 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-473669ee-4403-4ab7-bd69-99b0f13fa03f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:24.261133 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-473669ee-4403-4ab7-bd69-99b0f13fa03f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:24.274980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-473669ee-4403-4ab7-bd69-99b0f13fa03f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:24.275450 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-473669ee-4403-4ab7-bd69-99b0f13fa03f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:24.276248 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-473669ee-4403-4ab7-bd69-99b0f13fa03f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:24.276689 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-473669ee-4403-4ab7-bd69-99b0f13fa03f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:24.281229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:24.484883 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-473669ee-4403-4ab7-bd69-99b0f13fa03f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:24.503702 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-473669ee-4403-4ab7-bd69-99b0f13fa03f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.249080 Jul 28 06:39:24.504310 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 138/269] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:24 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:24.776645 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Flavor limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:39:24.777344 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Image limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:39:24.778088 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Flavor pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:39:24.778495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Image pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:39:24.778960 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:39:24.797147 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:24.801660 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:24.804239 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:24.806225 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:24.837172 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Getting quotas for project bafc15c173f94f8eb804e56a2d4673a8. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:39:24.843084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Getting quotas for user bb9f183ac716439aab70e789f9561901 and project bafc15c173f94f8eb804e56a2d4673a8. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:39:24.859677 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Going to run 1 instances... {{(pid=124562) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:39:24.862923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:39:24.928112 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-920719ec-4c7e-4f90-adb1-b2ab05e35c09 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:24.929262 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-920719ec-4c7e-4f90-adb1-b2ab05e35c09 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:24.939242 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-920719ec-4c7e-4f90-adb1-b2ab05e35c09 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:24.940073 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-920719ec-4c7e-4f90-adb1-b2ab05e35c09 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:24.941058 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-920719ec-4c7e-4f90-adb1-b2ab05e35c09 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:24.941727 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-920719ec-4c7e-4f90-adb1-b2ab05e35c09 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:24.960899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9fb7648a-9239-482f-935e-af1c973fc7de tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330057 Jul 28 06:39:24.962475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 132/270] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:39:24.974181 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2407346a-40fc-4efc-86ee-245319f822cc tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:24.974979 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2407346a-40fc-4efc-86ee-245319f822cc tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:25.662960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-920719ec-4c7e-4f90-adb1-b2ab05e35c09 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:25.673835 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2407346a-40fc-4efc-86ee-245319f822cc tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:25.685744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2407346a-40fc-4efc-86ee-245319f822cc tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1218 microversion: 2.1 time: 0.715140 Jul 28 06:39:25.697323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 133/271] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:24 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1218 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:25.697656 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-920719ec-4c7e-4f90-adb1-b2ab05e35c09 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1504 microversion: 2.1 time: 0.766802 Jul 28 06:39:25.697656 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 139/272] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:24 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1504 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:25.700275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c2ab585e-8a57-44c2-b060-b6c6bc544b3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:25.701266 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c2ab585e-8a57-44c2-b060-b6c6bc544b3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:25.717406 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c2ab585e-8a57-44c2-b060-b6c6bc544b3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:25.718217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c2ab585e-8a57-44c2-b060-b6c6bc544b3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:25.728329 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c2ab585e-8a57-44c2-b060-b6c6bc544b3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:25.728793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c2ab585e-8a57-44c2-b060-b6c6bc544b3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:26.091098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c2ab585e-8a57-44c2-b060-b6c6bc544b3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:26.099424 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c2ab585e-8a57-44c2-b060-b6c6bc544b3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.409278 Jul 28 06:39:26.103867 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 134/273] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:25 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:26.511036 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-68291e3d-5dad-4f5b-bfb0-a9c5774e9e60 req-266d4c9c-e5ed-40ae-a8cb-2a8939792c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d347e2-1f9f-4a20-96f0-ca175e3aacf5", "name": "network-vif-deleted", "tag": "9887f65c-7b0a-4a46-b6a9-9573f2d30ab5"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:26.521812 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-68291e3d-5dad-4f5b-bfb0-a9c5774e9e60 req-266d4c9c-e5ed-40ae-a8cb-2a8939792c0b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:26.522243 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-68291e3d-5dad-4f5b-bfb0-a9c5774e9e60 req-266d4c9c-e5ed-40ae-a8cb-2a8939792c0b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:26.535527 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-68291e3d-5dad-4f5b-bfb0-a9c5774e9e60 req-266d4c9c-e5ed-40ae-a8cb-2a8939792c0b service nova] Creating event network-vif-deleted:9887f65c-7b0a-4a46-b6a9-9573f2d30ab5 for instance 39d347e2-1f9f-4a20-96f0-ca175e3aacf5 on hv-cinder-85060 Jul 28 06:39:26.540433 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-68291e3d-5dad-4f5b-bfb0-a9c5774e9e60 req-266d4c9c-e5ed-40ae-a8cb-2a8939792c0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033033 Jul 28 06:39:26.544481 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 140/274] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:26.716397 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-897d0f7e-2846-4b62-9889-c18aba685f4a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:26.717452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-897d0f7e-2846-4b62-9889-c18aba685f4a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:26.725856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-897d0f7e-2846-4b62-9889-c18aba685f4a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:26.726540 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-897d0f7e-2846-4b62-9889-c18aba685f4a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:26.727365 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-897d0f7e-2846-4b62-9889-c18aba685f4a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:26.728076 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-897d0f7e-2846-4b62-9889-c18aba685f4a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:26.730614 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d2cb0f4d-76a5-4628-a14d-c50b878761da tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:26.731327 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d2cb0f4d-76a5-4628-a14d-c50b878761da tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:26.742455 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2cb0f4d-76a5-4628-a14d-c50b878761da tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:26.742664 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2cb0f4d-76a5-4628-a14d-c50b878761da tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:26.743454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2cb0f4d-76a5-4628-a14d-c50b878761da tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:26.743890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2cb0f4d-76a5-4628-a14d-c50b878761da tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:26.804356 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-897d0f7e-2846-4b62-9889-c18aba685f4a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:26.812930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-897d0f7e-2846-4b62-9889-c18aba685f4a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1270 microversion: 2.1 time: 0.100399 Jul 28 06:39:26.813829 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 135/275] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:26 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:26.839211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d2cb0f4d-76a5-4628-a14d-c50b878761da tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:26.847322 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d2cb0f4d-76a5-4628-a14d-c50b878761da tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1462 microversion: 2.1 time: 0.124634 Jul 28 06:39:26.848199 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 141/276] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:26 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1462 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:27.131137 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0a0f6d12-5486-47e4-bff0-fb0e0e93febb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:27.133317 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0a0f6d12-5486-47e4-bff0-fb0e0e93febb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:27.170771 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0a0f6d12-5486-47e4-bff0-fb0e0e93febb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:27.171950 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0a0f6d12-5486-47e4-bff0-fb0e0e93febb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:27.172731 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0a0f6d12-5486-47e4-bff0-fb0e0e93febb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:27.173267 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0a0f6d12-5486-47e4-bff0-fb0e0e93febb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:27.456838 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0a0f6d12-5486-47e4-bff0-fb0e0e93febb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:27.468178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0a0f6d12-5486-47e4-bff0-fb0e0e93febb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.346174 Jul 28 06:39:27.468790 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 136/277] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:27 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:27.836464 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-95d51aef-2e10-4006-957c-37aa9ebdcd41 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:27.837718 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-95d51aef-2e10-4006-957c-37aa9ebdcd41 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:27.845845 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-95d51aef-2e10-4006-957c-37aa9ebdcd41 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:27.846505 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-95d51aef-2e10-4006-957c-37aa9ebdcd41 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:27.847281 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-95d51aef-2e10-4006-957c-37aa9ebdcd41 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:27.847872 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-95d51aef-2e10-4006-957c-37aa9ebdcd41 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:27.870687 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:27.871294 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:27.885721 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:27.898211 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:27.899320 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:27.899909 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:27.940500 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-95d51aef-2e10-4006-957c-37aa9ebdcd41 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:27.951317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-95d51aef-2e10-4006-957c-37aa9ebdcd41 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1276 microversion: 2.1 time: 0.116767 Jul 28 06:39:27.952760 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:27.965398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:27.966792 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 142/278] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:27 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1276 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:27.968895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lazy-loading 'fault' on Instance uuid 39d347e2-1f9f-4a20-96f0-ca175e3aacf5 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:39:28.035035 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:28.052244 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5ebcab5b-d89f-49a7-b03e-771ec3214dcc tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 200 len: 1304 microversion: 2.1 time: 0.185159 Jul 28 06:39:28.054407 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 137/279] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:27 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:28.492441 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9dc6929a-0ce3-4764-957d-fcfdcbb8753f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:28.493059 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9dc6929a-0ce3-4764-957d-fcfdcbb8753f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:28.499531 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9dc6929a-0ce3-4764-957d-fcfdcbb8753f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:28.500014 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9dc6929a-0ce3-4764-957d-fcfdcbb8753f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:28.500784 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9dc6929a-0ce3-4764-957d-fcfdcbb8753f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:28.501895 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9dc6929a-0ce3-4764-957d-fcfdcbb8753f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:28.718080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9dc6929a-0ce3-4764-957d-fcfdcbb8753f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:28.732156 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9dc6929a-0ce3-4764-957d-fcfdcbb8753f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.243555 Jul 28 06:39:28.754404 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 143/280] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:28 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:28.979868 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5d2e6170-2d7a-4163-bd86-af42009d5990 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:28.981538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5d2e6170-2d7a-4163-bd86-af42009d5990 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:28.988527 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d2e6170-2d7a-4163-bd86-af42009d5990 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:28.989040 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d2e6170-2d7a-4163-bd86-af42009d5990 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:28.990071 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d2e6170-2d7a-4163-bd86-af42009d5990 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:28.990932 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d2e6170-2d7a-4163-bd86-af42009d5990 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:28.996303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:29.079309 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e5590c13-2ae1-44ce-894c-c85e1a0de380 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:29.080413 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e5590c13-2ae1-44ce-894c-c85e1a0de380 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 39d347e2-1f9f-4a20-96f0-ca175e3aacf5] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:29.093430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e5590c13-2ae1-44ce-894c-c85e1a0de380 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:29.096032 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e5590c13-2ae1-44ce-894c-c85e1a0de380 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:29.099842 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e5590c13-2ae1-44ce-894c-c85e1a0de380 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:29.101048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e5590c13-2ae1-44ce-894c-c85e1a0de380 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:29.133253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-e5590c13-2ae1-44ce-894c-c85e1a0de380 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] HTTP exception thrown: Instance 39d347e2-1f9f-4a20-96f0-ca175e3aacf5 could not be found. Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e5590c13-2ae1-44ce-894c-c85e1a0de380 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Request method failure captured: Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 HTTP/1.1 Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i8DL8NsrhrhVxSGTb8qzaJDnqNVzl4QkBU7L2yoQiF2rzBN9q5VCfA-UkPUHjOnl8yB6uGNyOwvSFNzMp4qR4dYbtaQV9__lQLJZn3WegkI41CnJ_a2wt99k-n4zb9q-G3X1RJlWqF7s0t6NEjCZLqsqIXduMANbF1AKcCXNdfACMI Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: 57601f159e244aa68924602c2c5dc385 Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-VolumesActionsTest-392965626 Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:39:29.135399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57601f159e244aa68924602c2c5dc385", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57601f159e244aa68924602c2c5dc385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57601f159e244aa68924602c2c5dc385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57601f159e244aa68924602c2c5dc385"}]}] Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-VolumesActionsTest-392965626 Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: 57601f159e244aa68924602c2c5dc385 Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-VolumesActionsTest-392965626 Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-VolumesActionsTest-392965626-project Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: ffc6812703254c51a4200abf3dee2d95 Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-VolumesActionsTest-392965626-project Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 39d347e2-1f9f-4a20-96f0-ca175e3aacf5 could not be found. Jul 28 06:39:29.138660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '39d347e2-1f9f-4a20-96f0-ca175e3aacf5'} Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d347e2-1f9f-4a20-96f0-ca175e3aacf5 could not be found. Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:39:29.140241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d347e2-1f9f-4a20-96f0-ca175e3aacf5 could not be found. Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d347e2-1f9f-4a20-96f0-ca175e3aacf5 could not be found. Jul 28 06:39:29.142847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:39:29.145018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e5590c13-2ae1-44ce-894c-c85e1a0de380 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Returning 404 to user: Instance 39d347e2-1f9f-4a20-96f0-ca175e3aacf5 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:39:29.145018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e5590c13-2ae1-44ce-894c-c85e1a0de380 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5" status: 404 len: 111 microversion: 2.1 time: 0.063838 Jul 28 06:39:29.147015 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 144/281] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:29 2022] GET /compute/v2.1/servers/39d347e2-1f9f-4a20-96f0-ca175e3aacf5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:39:29.246758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5d2e6170-2d7a-4163-bd86-af42009d5990 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:29.258213 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5d2e6170-2d7a-4163-bd86-af42009d5990 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1318 microversion: 2.1 time: 0.282281 Jul 28 06:39:29.269460 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 138/282] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:28 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:29.296580 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-968992056", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "networks": [{"uuid": "68f02050-09bf-429b-8750-a014c7a2dad3"}]}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:29.383060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] validate_networks() for [('68f02050-09bf-429b-8750-a014c7a2dad3', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:39:29.763452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4bf28371-d57c-4117-b29e-f3892a05212b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:29.764063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4bf28371-d57c-4117-b29e-f3892a05212b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:29.776591 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4bf28371-d57c-4117-b29e-f3892a05212b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:29.777025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4bf28371-d57c-4117-b29e-f3892a05212b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:29.780203 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4bf28371-d57c-4117-b29e-f3892a05212b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:29.780880 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4bf28371-d57c-4117-b29e-f3892a05212b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:30.120076 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:39:30.120599 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:39:30.121201 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:39:30.124978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:39:30.125448 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:39:30.146936 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:30.147380 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:30.148339 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:30.152675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:30.186396 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Getting quotas for project 57601f159e244aa68924602c2c5dc385. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:39:30.193121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Getting quotas for user ffc6812703254c51a4200abf3dee2d95 and project 57601f159e244aa68924602c2c5dc385. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:39:30.207180 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:39:30.210394 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:39:30.247635 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4bf28371-d57c-4117-b29e-f3892a05212b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:30.258961 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4bf28371-d57c-4117-b29e-f3892a05212b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.501553 Jul 28 06:39:30.260035 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 139/283] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:29 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:30.278834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-6bfccce3-43c1-464e-a47b-76245a809003 req-e5f47768-9d10-446c-a03f-63bd804a8746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d88edfe-4077-4ab9-a0aa-4225d54024a7", "tag": "41dcf4e4-f335-41a8-ae56-b0163407fe77"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:30.280408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0a3d6169-3e4c-4edc-a845-272889e12fec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989482 Jul 28 06:39:30.290061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 145/284] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:39:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:39:30.292088 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-6bfccce3-43c1-464e-a47b-76245a809003 req-e5f47768-9d10-446c-a03f-63bd804a8746 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:30.292544 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-6bfccce3-43c1-464e-a47b-76245a809003 req-e5f47768-9d10-446c-a03f-63bd804a8746 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:30.296215 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-41df9944-ccef-4143-93d3-540eb467690e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:30.296969 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-41df9944-ccef-4143-93d3-540eb467690e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:30.306418 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41df9944-ccef-4143-93d3-540eb467690e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:30.307140 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41df9944-ccef-4143-93d3-540eb467690e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:30.308092 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41df9944-ccef-4143-93d3-540eb467690e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:30.308677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41df9944-ccef-4143-93d3-540eb467690e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:30.314401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-6bfccce3-43c1-464e-a47b-76245a809003 req-e5f47768-9d10-446c-a03f-63bd804a8746 service nova] Creating event network-changed:41dcf4e4-f335-41a8-ae56-b0163407fe77 for instance 4d88edfe-4077-4ab9-a0aa-4225d54024a7 on hv-cinder-85060 Jul 28 06:39:30.321604 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-6bfccce3-43c1-464e-a47b-76245a809003 req-e5f47768-9d10-446c-a03f-63bd804a8746 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059578 Jul 28 06:39:30.322756 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 140/285] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:30.331398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-59d9bbe8-1865-4d5b-bfc1-ad63c8acc0c8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:30.332305 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-59d9bbe8-1865-4d5b-bfc1-ad63c8acc0c8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:30.340185 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-59d9bbe8-1865-4d5b-bfc1-ad63c8acc0c8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:30.341015 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-59d9bbe8-1865-4d5b-bfc1-ad63c8acc0c8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:30.342031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-59d9bbe8-1865-4d5b-bfc1-ad63c8acc0c8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:30.342635 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-59d9bbe8-1865-4d5b-bfc1-ad63c8acc0c8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:30.379253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-41df9944-ccef-4143-93d3-540eb467690e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lazy-loading 'flavor' on Instance uuid 019e1e9c-7545-477a-bae9-47c555ae07e2 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:39:30.726399 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-59d9bbe8-1865-4d5b-bfc1-ad63c8acc0c8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:30.769484 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-59d9bbe8-1865-4d5b-bfc1-ad63c8acc0c8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1318 microversion: 2.1 time: 0.423850 Jul 28 06:39:30.770889 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 141/286] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:30 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:30.783411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-31b68f94-4157-4659-8240-2a68a9294db7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:30.784309 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-31b68f94-4157-4659-8240-2a68a9294db7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:30.793513 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-41df9944-ccef-4143-93d3-540eb467690e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "POST /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/action" status: 202 len: 0 microversion: 2.20 time: 0.501696 Jul 28 06:39:30.796735 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 146/287] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Jul 28 06:39:30 2022] POST /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:39:30.815135 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8d77f2f2-d2d4-4b3b-bcd7-fa3d8e1271a0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:30.816161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8d77f2f2-d2d4-4b3b-bcd7-fa3d8e1271a0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:30.825320 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8d77f2f2-d2d4-4b3b-bcd7-fa3d8e1271a0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:30.826109 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8d77f2f2-d2d4-4b3b-bcd7-fa3d8e1271a0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:30.827054 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8d77f2f2-d2d4-4b3b-bcd7-fa3d8e1271a0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:30.827652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8d77f2f2-d2d4-4b3b-bcd7-fa3d8e1271a0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:31.038899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-31b68f94-4157-4659-8240-2a68a9294db7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:31.073461 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-31b68f94-4157-4659-8240-2a68a9294db7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1213 microversion: 2.1 time: 0.298488 Jul 28 06:39:31.075558 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 142/288] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:30 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1213 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:31.201945 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8d77f2f2-d2d4-4b3b-bcd7-fa3d8e1271a0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:31.211815 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8d77f2f2-d2d4-4b3b-bcd7-fa3d8e1271a0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:31.217002 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8d77f2f2-d2d4-4b3b-bcd7-fa3d8e1271a0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:31.223566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8d77f2f2-d2d4-4b3b-bcd7-fa3d8e1271a0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.418330 Jul 28 06:39:31.249993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 147/289] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:30 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:31.296041 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-964dac17-6cfa-42b7-87e5-81eaf3897a84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:31.297594 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-964dac17-6cfa-42b7-87e5-81eaf3897a84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:31.316425 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-964dac17-6cfa-42b7-87e5-81eaf3897a84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:31.316881 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-964dac17-6cfa-42b7-87e5-81eaf3897a84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:31.333838 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-964dac17-6cfa-42b7-87e5-81eaf3897a84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:31.336781 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-964dac17-6cfa-42b7-87e5-81eaf3897a84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:31.730411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-964dac17-6cfa-42b7-87e5-81eaf3897a84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:31.742703 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-964dac17-6cfa-42b7-87e5-81eaf3897a84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.455292 Jul 28 06:39:31.744761 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 143/290] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:31 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:31.793093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a4d64086-dd6a-4c03-8cbb-4792df2ad5da tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:31.793713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a4d64086-dd6a-4c03-8cbb-4792df2ad5da tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:31.815589 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a4d64086-dd6a-4c03-8cbb-4792df2ad5da tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:31.816041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a4d64086-dd6a-4c03-8cbb-4792df2ad5da tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:31.816825 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a4d64086-dd6a-4c03-8cbb-4792df2ad5da tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:31.817256 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a4d64086-dd6a-4c03-8cbb-4792df2ad5da tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:32.096386 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a4d64086-dd6a-4c03-8cbb-4792df2ad5da tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:32.108306 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5d7d6fd6-f0f9-4838-a596-686cf7bb8374 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:32.108927 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5d7d6fd6-f0f9-4838-a596-686cf7bb8374 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:32.110437 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a4d64086-dd6a-4c03-8cbb-4792df2ad5da tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1318 microversion: 2.1 time: 0.320949 Jul 28 06:39:32.113144 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 148/291] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:31 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:32.121368 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d7d6fd6-f0f9-4838-a596-686cf7bb8374 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:32.129518 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d7d6fd6-f0f9-4838-a596-686cf7bb8374 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:32.132309 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d7d6fd6-f0f9-4838-a596-686cf7bb8374 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:32.133553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d7d6fd6-f0f9-4838-a596-686cf7bb8374 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:32.234801 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5d7d6fd6-f0f9-4838-a596-686cf7bb8374 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:32.244348 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5d7d6fd6-f0f9-4838-a596-686cf7bb8374 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1265 microversion: 2.1 time: 0.141521 Jul 28 06:39:32.244925 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 144/292] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:32 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:32.266163 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-79eab316-cb81-444e-abd8-1398cdd6e6b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:32.267757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-79eab316-cb81-444e-abd8-1398cdd6e6b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:32.289231 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79eab316-cb81-444e-abd8-1398cdd6e6b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:32.297691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79eab316-cb81-444e-abd8-1398cdd6e6b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:32.299882 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79eab316-cb81-444e-abd8-1398cdd6e6b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:32.300562 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79eab316-cb81-444e-abd8-1398cdd6e6b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:32.591038 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-79eab316-cb81-444e-abd8-1398cdd6e6b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:32.603728 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-79eab316-cb81-444e-abd8-1398cdd6e6b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:32.605717 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-79eab316-cb81-444e-abd8-1398cdd6e6b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:32.607216 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-79eab316-cb81-444e-abd8-1398cdd6e6b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.348429 Jul 28 06:39:32.608368 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 149/293] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:32 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:32.764037 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7c9c7ff0-9503-4e03-9fa7-81fa3ffa8d5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:32.764620 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7c9c7ff0-9503-4e03-9fa7-81fa3ffa8d5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:32.775118 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7c9c7ff0-9503-4e03-9fa7-81fa3ffa8d5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:32.775567 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7c9c7ff0-9503-4e03-9fa7-81fa3ffa8d5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:32.777937 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7c9c7ff0-9503-4e03-9fa7-81fa3ffa8d5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:32.778726 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7c9c7ff0-9503-4e03-9fa7-81fa3ffa8d5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:32.968046 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7c9c7ff0-9503-4e03-9fa7-81fa3ffa8d5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:32.978545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7c9c7ff0-9503-4e03-9fa7-81fa3ffa8d5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.216955 Jul 28 06:39:32.979729 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 145/294] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:32 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:33.134340 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5ee9f4ad-30e6-4a49-a7eb-fb6d5e98399f tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:33.135853 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5ee9f4ad-30e6-4a49-a7eb-fb6d5e98399f tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:33.146979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5ee9f4ad-30e6-4a49-a7eb-fb6d5e98399f tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:33.148578 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5ee9f4ad-30e6-4a49-a7eb-fb6d5e98399f tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:33.149997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5ee9f4ad-30e6-4a49-a7eb-fb6d5e98399f tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:33.150666 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5ee9f4ad-30e6-4a49-a7eb-fb6d5e98399f tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:33.274432 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b7ca3e91-baed-479b-83e6-7af0456fd658 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:33.275619 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b7ca3e91-baed-479b-83e6-7af0456fd658 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:33.289755 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ca3e91-baed-479b-83e6-7af0456fd658 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:33.290543 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ca3e91-baed-479b-83e6-7af0456fd658 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:33.291878 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ca3e91-baed-479b-83e6-7af0456fd658 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:33.294989 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ca3e91-baed-479b-83e6-7af0456fd658 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:33.440815 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b7ca3e91-baed-479b-83e6-7af0456fd658 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:33.452076 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b7ca3e91-baed-479b-83e6-7af0456fd658 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1265 microversion: 2.1 time: 0.181975 Jul 28 06:39:33.453105 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 146/295] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:33 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:33.484349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5ee9f4ad-30e6-4a49-a7eb-fb6d5e98399f tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:33.492982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5ee9f4ad-30e6-4a49-a7eb-fb6d5e98399f tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1318 microversion: 2.1 time: 0.363823 Jul 28 06:39:33.498900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 150/296] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:33 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:33.633867 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-8e2a0221-521c-4a71-979f-4cd24663f3ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:33.634209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-8e2a0221-521c-4a71-979f-4cd24663f3ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:33.642185 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8e2a0221-521c-4a71-979f-4cd24663f3ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:33.646820 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8e2a0221-521c-4a71-979f-4cd24663f3ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:33.649048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8e2a0221-521c-4a71-979f-4cd24663f3ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:33.660461 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8e2a0221-521c-4a71-979f-4cd24663f3ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:33.900970 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1109995135", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-306828582", "security_groups": [{"name": "tempest-secgroup-smoke-1325947969"}], "block_device_mapping_v2": [{"uuid": "985dc747-f06a-429e-9a46-b52e1b69c955", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eec19e8-2941-4311-8a4f-2b98c90d5895"}]}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:34.257934 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8e2a0221-521c-4a71-979f-4cd24663f3ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:34.276412 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8e2a0221-521c-4a71-979f-4cd24663f3ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:34.282895 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] validate_networks() for [('5eec19e8-2941-4311-8a4f-2b98c90d5895', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:39:34.291871 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8e2a0221-521c-4a71-979f-4cd24663f3ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:34.294219 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-8e2a0221-521c-4a71-979f-4cd24663f3ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.664935 Jul 28 06:39:34.303207 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 147/297] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:33 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:34.321331 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-42122c8f-5235-4d36-9240-5cf7655df87d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:34.334229 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-42122c8f-5235-4d36-9240-5cf7655df87d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:34.343275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-42122c8f-5235-4d36-9240-5cf7655df87d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:34.354029 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-42122c8f-5235-4d36-9240-5cf7655df87d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:34.355140 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-42122c8f-5235-4d36-9240-5cf7655df87d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:34.355811 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-42122c8f-5235-4d36-9240-5cf7655df87d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:34.661654 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-42122c8f-5235-4d36-9240-5cf7655df87d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:34.672348 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-42122c8f-5235-4d36-9240-5cf7655df87d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.367592 Jul 28 06:39:34.682941 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 148/298] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:34 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:34.692752 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c9a28d60-55fe-4e8e-85da-544988757510 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:34.693883 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c9a28d60-55fe-4e8e-85da-544988757510 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:34.709076 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c9a28d60-55fe-4e8e-85da-544988757510 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:34.710415 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c9a28d60-55fe-4e8e-85da-544988757510 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:34.711504 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c9a28d60-55fe-4e8e-85da-544988757510 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:34.712559 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c9a28d60-55fe-4e8e-85da-544988757510 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:34.823005 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:34.853549 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c9a28d60-55fe-4e8e-85da-544988757510 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:34.872484 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c9a28d60-55fe-4e8e-85da-544988757510 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1271 microversion: 2.1 time: 0.188100 Jul 28 06:39:34.873097 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 149/299] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:34 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:34.880036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3bad3397-31c7-4955-af66-53e86841b7c3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:34.882036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3bad3397-31c7-4955-af66-53e86841b7c3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:34.896122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3bad3397-31c7-4955-af66-53e86841b7c3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:34.899187 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3bad3397-31c7-4955-af66-53e86841b7c3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:34.914217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3bad3397-31c7-4955-af66-53e86841b7c3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:34.914217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3bad3397-31c7-4955-af66-53e86841b7c3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:35.171091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:39:35.172209 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:39:35.173043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:39:35.173820 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:39:35.174396 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:39:35.185629 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:35.186307 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:35.187271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:35.187866 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:35.217093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Getting quotas for project f16eee0fb716452e8c760a27b5724d91. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:39:35.223251 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Getting quotas for user 13ca4be686f84c279f87016c20129833 and project f16eee0fb716452e8c760a27b5724d91. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:39:35.332988 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:39:35.335756 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='985dc747-f06a-429e-9a46-b52e1b69c955',volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:39:35.538923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3bad3397-31c7-4955-af66-53e86841b7c3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:35.554505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3bad3397-31c7-4955-af66-53e86841b7c3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1318 microversion: 2.1 time: 0.680237 Jul 28 06:39:35.557145 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 150/300] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:34 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1318 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:35.577512 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d0e428e1-8a62-4258-9386-d79ee94860a7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:35.578743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d0e428e1-8a62-4258-9386-d79ee94860a7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:35.606717 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0e428e1-8a62-4258-9386-d79ee94860a7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:35.609756 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0e428e1-8a62-4258-9386-d79ee94860a7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:35.614303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0e428e1-8a62-4258-9386-d79ee94860a7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:35.614981 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0e428e1-8a62-4258-9386-d79ee94860a7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:35.670061 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d0e428e1-8a62-4258-9386-d79ee94860a7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/ips" status: 200 len: 150 microversion: 2.1 time: 0.111777 Jul 28 06:39:35.672665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 151/301] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Jul 28 06:39:35 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/ips => generated 150 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:35.680194 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0a0e63ff-15f6-4cbd-977f-d1883f1baa38 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:35.681280 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0a0e63ff-15f6-4cbd-977f-d1883f1baa38 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:35.690913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0a0e63ff-15f6-4cbd-977f-d1883f1baa38 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:35.691771 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0a0e63ff-15f6-4cbd-977f-d1883f1baa38 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:35.693046 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0a0e63ff-15f6-4cbd-977f-d1883f1baa38 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:35.693951 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0a0e63ff-15f6-4cbd-977f-d1883f1baa38 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:35.696949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d832c2e6-1103-4d7c-a120-8ad28c2789b5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.807642 Jul 28 06:39:35.697851 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 151/302] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:39:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:39:35.712894 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-69b2196a-3dca-4fe8-b3ce-bc9c584a9c74 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:35.713962 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-69b2196a-3dca-4fe8-b3ce-bc9c584a9c74 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:35.729331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-69b2196a-3dca-4fe8-b3ce-bc9c584a9c74 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:35.730086 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-69b2196a-3dca-4fe8-b3ce-bc9c584a9c74 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:35.731307 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-69b2196a-3dca-4fe8-b3ce-bc9c584a9c74 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:35.733915 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-69b2196a-3dca-4fe8-b3ce-bc9c584a9c74 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:36.070562 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-69b2196a-3dca-4fe8-b3ce-bc9c584a9c74 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:36.080044 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-69b2196a-3dca-4fe8-b3ce-bc9c584a9c74 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.378749 Jul 28 06:39:36.081147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 152/303] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:35 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:36.087104 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1b540abf-c986-4d42-92d9-d0a29d4d0958 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:36.095810 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1b540abf-c986-4d42-92d9-d0a29d4d0958 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:36.233106 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1b540abf-c986-4d42-92d9-d0a29d4d0958 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:36.241163 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1b540abf-c986-4d42-92d9-d0a29d4d0958 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1094 microversion: 2.1 time: 0.158547 Jul 28 06:39:36.251814 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 153/304] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:36 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1094 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:36.283158 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-926ca442-3919-4cb1-81a9-f98b1ac6aeaf tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:36.287359 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-926ca442-3919-4cb1-81a9-f98b1ac6aeaf tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:36.313081 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-926ca442-3919-4cb1-81a9-f98b1ac6aeaf tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:36.317525 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-926ca442-3919-4cb1-81a9-f98b1ac6aeaf tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:36.319861 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-926ca442-3919-4cb1-81a9-f98b1ac6aeaf tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:36.323934 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-926ca442-3919-4cb1-81a9-f98b1ac6aeaf tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:36.450788 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-926ca442-3919-4cb1-81a9-f98b1ac6aeaf tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:36.463868 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-926ca442-3919-4cb1-81a9-f98b1ac6aeaf tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1271 microversion: 2.1 time: 0.208908 Jul 28 06:39:36.465181 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 154/305] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:36 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:36.582400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-09d3af7c-088a-4161-87ef-34d6780ba427 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:36.583207 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-09d3af7c-088a-4161-87ef-34d6780ba427 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:36.607906 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09d3af7c-088a-4161-87ef-34d6780ba427 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:36.608701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09d3af7c-088a-4161-87ef-34d6780ba427 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:36.615637 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09d3af7c-088a-4161-87ef-34d6780ba427 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:36.616426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09d3af7c-088a-4161-87ef-34d6780ba427 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:36.851439 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-09d3af7c-088a-4161-87ef-34d6780ba427 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:36.863928 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-09d3af7c-088a-4161-87ef-34d6780ba427 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1318 microversion: 2.1 time: 0.287200 Jul 28 06:39:36.877464 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 155/306] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:36 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:36.932437 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0a0e63ff-15f6-4cbd-977f-d1883f1baa38 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:36.941594 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0a0e63ff-15f6-4cbd-977f-d1883f1baa38 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:36.948000 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0a0e63ff-15f6-4cbd-977f-d1883f1baa38 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:36.949533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0a0e63ff-15f6-4cbd-977f-d1883f1baa38 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 1.274172 Jul 28 06:39:36.950309 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 152/307] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:35 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:37.121024 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1e79b70f-b100-4506-85f3-9ad3c714a4d1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:37.122235 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1e79b70f-b100-4506-85f3-9ad3c714a4d1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:37.130579 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e79b70f-b100-4506-85f3-9ad3c714a4d1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:37.131257 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e79b70f-b100-4506-85f3-9ad3c714a4d1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:37.132397 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e79b70f-b100-4506-85f3-9ad3c714a4d1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:37.132861 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e79b70f-b100-4506-85f3-9ad3c714a4d1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:37.155834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:37.274416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-54eb579c-dec8-4376-98b4-55d2fdb31bd0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:37.275397 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-54eb579c-dec8-4376-98b4-55d2fdb31bd0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:37.291421 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54eb579c-dec8-4376-98b4-55d2fdb31bd0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:37.293398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54eb579c-dec8-4376-98b4-55d2fdb31bd0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:37.294666 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54eb579c-dec8-4376-98b4-55d2fdb31bd0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:37.295325 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54eb579c-dec8-4376-98b4-55d2fdb31bd0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:37.375679 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1e79b70f-b100-4506-85f3-9ad3c714a4d1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:37.381927 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-54eb579c-dec8-4376-98b4-55d2fdb31bd0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:37.388167 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1e79b70f-b100-4506-85f3-9ad3c714a4d1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.287137 Jul 28 06:39:37.389859 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-54eb579c-dec8-4376-98b4-55d2fdb31bd0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1192 microversion: 2.1 time: 0.120038 Jul 28 06:39:37.390367 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 156/308] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:37 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:37.390758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 153/309] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:37 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1192 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:37.486612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-68f0ef33-6ca5-4dd6-9dab-0ed78b23f817 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:37.487526 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-68f0ef33-6ca5-4dd6-9dab-0ed78b23f817 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:37.493908 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-68f0ef33-6ca5-4dd6-9dab-0ed78b23f817 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:37.494353 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-68f0ef33-6ca5-4dd6-9dab-0ed78b23f817 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:37.495113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-68f0ef33-6ca5-4dd6-9dab-0ed78b23f817 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:37.495573 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-68f0ef33-6ca5-4dd6-9dab-0ed78b23f817 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:37.678302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-68f0ef33-6ca5-4dd6-9dab-0ed78b23f817 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:37.689604 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-68f0ef33-6ca5-4dd6-9dab-0ed78b23f817 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.205006 Jul 28 06:39:37.690218 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 154/310] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:37 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:37.764853 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c13805fd-603e-4b4b-be01-4b8e57fb131c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76b18e9c-774a-4ca2-8ea8-91af9149c017"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:37.768378 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c13805fd-603e-4b4b-be01-4b8e57fb131c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:37.778230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c13805fd-603e-4b4b-be01-4b8e57fb131c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:37.778685 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c13805fd-603e-4b4b-be01-4b8e57fb131c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:37.779474 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c13805fd-603e-4b4b-be01-4b8e57fb131c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:37.781681 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c13805fd-603e-4b4b-be01-4b8e57fb131c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:37.888440 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-22824b2f-c5d6-4645-bf03-c569f2dbe407 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:37.889065 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-22824b2f-c5d6-4645-bf03-c569f2dbe407 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:37.898376 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-22824b2f-c5d6-4645-bf03-c569f2dbe407 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:37.898829 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-22824b2f-c5d6-4645-bf03-c569f2dbe407 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:37.899619 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-22824b2f-c5d6-4645-bf03-c569f2dbe407 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:37.900054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-22824b2f-c5d6-4645-bf03-c569f2dbe407 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:38.310914 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c13805fd-603e-4b4b-be01-4b8e57fb131c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.551397 Jul 28 06:39:38.312137 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 157/311] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:39:37 2022] POST /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:38.338669 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b0da02fc-c946-4d7b-b6ff-75fd874a49ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:38.346756 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-22824b2f-c5d6-4645-bf03-c569f2dbe407 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:38.351120 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b0da02fc-c946-4d7b-b6ff-75fd874a49ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:38.356850 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-22824b2f-c5d6-4645-bf03-c569f2dbe407 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1318 microversion: 2.1 time: 0.473439 Jul 28 06:39:38.370098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 155/312] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:37 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:38.375160 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-0b522d57-2685-4d67-a7c8-86573d078a60 req-d30bbc35-d221-4eb0-a3ab-7cb51a7ec108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88edfe-4077-4ab9-a0aa-4225d54024a7", "name": "network-vif-plugged", "status": "completed", "tag": "41dcf4e4-f335-41a8-ae56-b0163407fe77"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:38.390531 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-0b522d57-2685-4d67-a7c8-86573d078a60 req-d30bbc35-d221-4eb0-a3ab-7cb51a7ec108 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:38.391210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0da02fc-c946-4d7b-b6ff-75fd874a49ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:38.392749 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-0b522d57-2685-4d67-a7c8-86573d078a60 req-d30bbc35-d221-4eb0-a3ab-7cb51a7ec108 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:38.399283 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0da02fc-c946-4d7b-b6ff-75fd874a49ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:38.401041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0da02fc-c946-4d7b-b6ff-75fd874a49ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:38.404003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0da02fc-c946-4d7b-b6ff-75fd874a49ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:38.426158 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-0b522d57-2685-4d67-a7c8-86573d078a60 req-d30bbc35-d221-4eb0-a3ab-7cb51a7ec108 service nova] Creating event network-vif-plugged:41dcf4e4-f335-41a8-ae56-b0163407fe77 for instance 4d88edfe-4077-4ab9-a0aa-4225d54024a7 on hv-cinder-85060 Jul 28 06:39:38.432084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-0b522d57-2685-4d67-a7c8-86573d078a60 req-d30bbc35-d221-4eb0-a3ab-7cb51a7ec108 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060432 Jul 28 06:39:38.439701 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 156/313] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:38.448928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-29d8a9b3-df12-424e-9ade-cd4801d78fda tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:38.453195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-29d8a9b3-df12-424e-9ade-cd4801d78fda tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:38.479860 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-29d8a9b3-df12-424e-9ade-cd4801d78fda tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:38.480518 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-29d8a9b3-df12-424e-9ade-cd4801d78fda tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:38.486525 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-29d8a9b3-df12-424e-9ade-cd4801d78fda tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:38.487146 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-29d8a9b3-df12-424e-9ade-cd4801d78fda tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:38.513616 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:38.727110 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b0da02fc-c946-4d7b-b6ff-75fd874a49ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:38.737806 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b0da02fc-c946-4d7b-b6ff-75fd874a49ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:38.749514 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b0da02fc-c946-4d7b-b6ff-75fd874a49ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:38.752458 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b0da02fc-c946-4d7b-b6ff-75fd874a49ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.436548 Jul 28 06:39:38.753335 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 158/314] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:38 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:38.760834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2a8508c0-7040-4695-abfe-dd58afe1bb61 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:38.761979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2a8508c0-7040-4695-abfe-dd58afe1bb61 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:38.787891 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2a8508c0-7040-4695-abfe-dd58afe1bb61 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:38.788359 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2a8508c0-7040-4695-abfe-dd58afe1bb61 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:38.789149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2a8508c0-7040-4695-abfe-dd58afe1bb61 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:38.800113 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2a8508c0-7040-4695-abfe-dd58afe1bb61 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:38.877883 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-29d8a9b3-df12-424e-9ade-cd4801d78fda tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:38.888123 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-29d8a9b3-df12-424e-9ade-cd4801d78fda tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.443357 Jul 28 06:39:38.890750 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 157/315] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:38 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:38.895184 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2a8508c0-7040-4695-abfe-dd58afe1bb61 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:38.897166 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f85eead9-c79d-48f8-8600-dde991de42a7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:38.898055 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f85eead9-c79d-48f8-8600-dde991de42a7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:38.904215 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f85eead9-c79d-48f8-8600-dde991de42a7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:38.904951 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f85eead9-c79d-48f8-8600-dde991de42a7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:38.905982 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f85eead9-c79d-48f8-8600-dde991de42a7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:38.906513 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2a8508c0-7040-4695-abfe-dd58afe1bb61 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1210 microversion: 2.1 time: 0.151641 Jul 28 06:39:38.906881 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f85eead9-c79d-48f8-8600-dde991de42a7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:38.910893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 159/316] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:38 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:39.421535 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0727f0c9-6f0d-4e44-b71e-159ed20feec6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:39.423794 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0727f0c9-6f0d-4e44-b71e-159ed20feec6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:39.443003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0727f0c9-6f0d-4e44-b71e-159ed20feec6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.443796 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0727f0c9-6f0d-4e44-b71e-159ed20feec6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.444683 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0727f0c9-6f0d-4e44-b71e-159ed20feec6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.445190 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0727f0c9-6f0d-4e44-b71e-159ed20feec6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.680466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0727f0c9-6f0d-4e44-b71e-159ed20feec6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:39.695676 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0727f0c9-6f0d-4e44-b71e-159ed20feec6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1318 microversion: 2.1 time: 0.306687 Jul 28 06:39:39.705036 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 160/317] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:39 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:39.708643 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f85eead9-c79d-48f8-8600-dde991de42a7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:39.715987 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-0729c504-1457-4bc9-8c2e-809202676e15 req-acf81a3e-5ece-4940-827b-e067a261c321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c8cbe2-7d60-4ddb-b580-02fd7b8d7148", "tag": "3e5d434a-57c7-43e3-a3af-c419d61fcc19"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:39.721973 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f85eead9-c79d-48f8-8600-dde991de42a7 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.829850 Jul 28 06:39:39.728320 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 158/318] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:38 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:39.748061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-0729c504-1457-4bc9-8c2e-809202676e15 req-acf81a3e-5ece-4940-827b-e067a261c321 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.748515 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-0729c504-1457-4bc9-8c2e-809202676e15 req-acf81a3e-5ece-4940-827b-e067a261c321 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.763648 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-0729c504-1457-4bc9-8c2e-809202676e15 req-acf81a3e-5ece-4940-827b-e067a261c321 service nova] Creating event network-changed:3e5d434a-57c7-43e3-a3af-c419d61fcc19 for instance 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 on hv-cinder-85060 Jul 28 06:39:39.772386 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-0729c504-1457-4bc9-8c2e-809202676e15 req-acf81a3e-5ece-4940-827b-e067a261c321 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065619 Jul 28 06:39:39.774279 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 161/319] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:39.783292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9391df4e-2a1b-4e0c-b964-e1b66cee77b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:39.784449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9391df4e-2a1b-4e0c-b964-e1b66cee77b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:39.792627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9391df4e-2a1b-4e0c-b964-e1b66cee77b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.793890 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9391df4e-2a1b-4e0c-b964-e1b66cee77b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.795063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9391df4e-2a1b-4e0c-b964-e1b66cee77b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.795712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9391df4e-2a1b-4e0c-b964-e1b66cee77b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.913375 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-baadc163-1e3a-4ec5-95dd-c2f8202e9899 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:39.914170 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-baadc163-1e3a-4ec5-95dd-c2f8202e9899 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:39.920908 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baadc163-1e3a-4ec5-95dd-c2f8202e9899 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.921684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baadc163-1e3a-4ec5-95dd-c2f8202e9899 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.922953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baadc163-1e3a-4ec5-95dd-c2f8202e9899 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.923499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-baadc163-1e3a-4ec5-95dd-c2f8202e9899 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:40.033661 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9391df4e-2a1b-4e0c-b964-e1b66cee77b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:40.043324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9391df4e-2a1b-4e0c-b964-e1b66cee77b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:40.045444 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9391df4e-2a1b-4e0c-b964-e1b66cee77b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:40.046951 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9391df4e-2a1b-4e0c-b964-e1b66cee77b0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.268588 Jul 28 06:39:40.062304 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 159/320] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:39 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:40.072246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-23a65092-3b0c-4f0d-92ca-eeb51a6e3062 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:40.073426 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-23a65092-3b0c-4f0d-92ca-eeb51a6e3062 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:40.080848 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23a65092-3b0c-4f0d-92ca-eeb51a6e3062 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:40.081636 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23a65092-3b0c-4f0d-92ca-eeb51a6e3062 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:40.083475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23a65092-3b0c-4f0d-92ca-eeb51a6e3062 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:40.084108 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-23a65092-3b0c-4f0d-92ca-eeb51a6e3062 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:40.109775 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-baadc163-1e3a-4ec5-95dd-c2f8202e9899 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:40.127623 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-baadc163-1e3a-4ec5-95dd-c2f8202e9899 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.218825 Jul 28 06:39:40.129348 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 162/321] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:39 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:40.455017 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-23a65092-3b0c-4f0d-92ca-eeb51a6e3062 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:40.466585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-23a65092-3b0c-4f0d-92ca-eeb51a6e3062 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1278 microversion: 2.1 time: 0.402576 Jul 28 06:39:40.467341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 160/322] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:40 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1278 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:40.719143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6c121bf9-797f-458b-944b-92cc51578a05 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:40.721495 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6c121bf9-797f-458b-944b-92cc51578a05 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:40.756504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c121bf9-797f-458b-944b-92cc51578a05 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:40.757426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c121bf9-797f-458b-944b-92cc51578a05 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:40.757896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ff98272f-448a-4068-afa6-602e76471f23 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:40.759005 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c121bf9-797f-458b-944b-92cc51578a05 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:40.759141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ff98272f-448a-4068-afa6-602e76471f23 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:40.759751 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c121bf9-797f-458b-944b-92cc51578a05 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:40.773922 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:40.777194 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff98272f-448a-4068-afa6-602e76471f23 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:40.778754 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff98272f-448a-4068-afa6-602e76471f23 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:40.780006 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff98272f-448a-4068-afa6-602e76471f23 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:40.780690 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff98272f-448a-4068-afa6-602e76471f23 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:40.958600 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6c121bf9-797f-458b-944b-92cc51578a05 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:40.967811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6c121bf9-797f-458b-944b-92cc51578a05 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1507 microversion: 2.1 time: 0.253143 Jul 28 06:39:40.968403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 163/323] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:40 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:41.042613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ff98272f-448a-4068-afa6-602e76471f23 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:41.053569 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ff98272f-448a-4068-afa6-602e76471f23 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.303490 Jul 28 06:39:41.054823 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 161/324] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:40 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:41.077706 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6b4f3e2e-8472-42e7-a4c0-1d5c8c9bf596 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:41.078630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6b4f3e2e-8472-42e7-a4c0-1d5c8c9bf596 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:41.086206 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:41.088242 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6b4f3e2e-8472-42e7-a4c0-1d5c8c9bf596 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:41.088885 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6b4f3e2e-8472-42e7-a4c0-1d5c8c9bf596 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:41.090112 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6b4f3e2e-8472-42e7-a4c0-1d5c8c9bf596 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:41.090748 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6b4f3e2e-8472-42e7-a4c0-1d5c8c9bf596 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:41.152179 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2af33d6b-d51a-485e-ab3d-86ee8ba9a37f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:41.153580 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2af33d6b-d51a-485e-ab3d-86ee8ba9a37f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:41.164479 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=10 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:41.168401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2af33d6b-d51a-485e-ab3d-86ee8ba9a37f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:41.171742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2af33d6b-d51a-485e-ab3d-86ee8ba9a37f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:41.174054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2af33d6b-d51a-485e-ab3d-86ee8ba9a37f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:41.176789 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2af33d6b-d51a-485e-ab3d-86ee8ba9a37f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:41.255365 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6b4f3e2e-8472-42e7-a4c0-1d5c8c9bf596 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:41.275452 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6b4f3e2e-8472-42e7-a4c0-1d5c8c9bf596 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:41.278739 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6b4f3e2e-8472-42e7-a4c0-1d5c8c9bf596 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:41.280229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6b4f3e2e-8472-42e7-a4c0-1d5c8c9bf596 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.207838 Jul 28 06:39:41.299658 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 164/325] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:41 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:41.489593 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-97afe452-28c4-49ac-888d-701bfd958c08 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:41.490448 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-97afe452-28c4-49ac-888d-701bfd958c08 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:41.502390 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-97afe452-28c4-49ac-888d-701bfd958c08 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:41.504905 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-97afe452-28c4-49ac-888d-701bfd958c08 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:41.506777 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-97afe452-28c4-49ac-888d-701bfd958c08 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:41.507332 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-97afe452-28c4-49ac-888d-701bfd958c08 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:41.527752 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2af33d6b-d51a-485e-ab3d-86ee8ba9a37f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:41.541040 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2af33d6b-d51a-485e-ab3d-86ee8ba9a37f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.390533 Jul 28 06:39:41.543282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 162/326] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:41 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:41.738622 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-97afe452-28c4-49ac-888d-701bfd958c08 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:41.747680 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-97afe452-28c4-49ac-888d-701bfd958c08 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.262700 Jul 28 06:39:41.749790 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 165/327] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:41 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:41.819432 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-687cddd5-339e-4db3-99a3-02d1020f81e1 req-f1cfd184-39ca-49b0-9f0f-ebeb18c44e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a882b29e-1e41-4e8d-a8ed-7cdd735d175e", "tag": "f779dd90-25ac-4b48-b542-655c148fc093"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:41.839270 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-687cddd5-339e-4db3-99a3-02d1020f81e1 req-f1cfd184-39ca-49b0-9f0f-ebeb18c44e2d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:41.840194 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-687cddd5-339e-4db3-99a3-02d1020f81e1 req-f1cfd184-39ca-49b0-9f0f-ebeb18c44e2d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:41.864545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-687cddd5-339e-4db3-99a3-02d1020f81e1 req-f1cfd184-39ca-49b0-9f0f-ebeb18c44e2d service nova] Creating event network-changed:f779dd90-25ac-4b48-b542-655c148fc093 for instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e on hv-cinder-85060 Jul 28 06:39:41.870480 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-687cddd5-339e-4db3-99a3-02d1020f81e1 req-f1cfd184-39ca-49b0-9f0f-ebeb18c44e2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055416 Jul 28 06:39:41.871850 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 163/328] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:42.075134 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-572c6d63-42ed-49c5-bd06-1bb38ebd00c3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:42.075961 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-572c6d63-42ed-49c5-bd06-1bb38ebd00c3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:42.098956 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-572c6d63-42ed-49c5-bd06-1bb38ebd00c3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:42.099687 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-572c6d63-42ed-49c5-bd06-1bb38ebd00c3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:42.100697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-572c6d63-42ed-49c5-bd06-1bb38ebd00c3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:42.101395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-572c6d63-42ed-49c5-bd06-1bb38ebd00c3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:42.300955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-572c6d63-42ed-49c5-bd06-1bb38ebd00c3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:42.311551 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-44c3a37e-9e2a-44a4-bf0b-255a8beff4f0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:42.313246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-44c3a37e-9e2a-44a4-bf0b-255a8beff4f0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:42.327957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-572c6d63-42ed-49c5-bd06-1bb38ebd00c3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.257958 Jul 28 06:39:42.332109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-44c3a37e-9e2a-44a4-bf0b-255a8beff4f0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:42.332425 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 166/329] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:42 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:42.333204 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-44c3a37e-9e2a-44a4-bf0b-255a8beff4f0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:42.334182 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-44c3a37e-9e2a-44a4-bf0b-255a8beff4f0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:42.334772 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-44c3a37e-9e2a-44a4-bf0b-255a8beff4f0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:42.557653 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-44c3a37e-9e2a-44a4-bf0b-255a8beff4f0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:42.562625 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dcb4f3ee-3144-4860-b4b8-2cff1343c104 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:42.563419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-dcb4f3ee-3144-4860-b4b8-2cff1343c104 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:42.574123 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcb4f3ee-3144-4860-b4b8-2cff1343c104 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:42.574577 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcb4f3ee-3144-4860-b4b8-2cff1343c104 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:42.575351 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcb4f3ee-3144-4860-b4b8-2cff1343c104 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:42.575786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcb4f3ee-3144-4860-b4b8-2cff1343c104 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:42.577397 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-44c3a37e-9e2a-44a4-bf0b-255a8beff4f0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:42.580075 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-44c3a37e-9e2a-44a4-bf0b-255a8beff4f0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:42.581486 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-44c3a37e-9e2a-44a4-bf0b-255a8beff4f0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.275952 Jul 28 06:39:42.586813 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 164/330] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:42 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:42.724597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dcb4f3ee-3144-4860-b4b8-2cff1343c104 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:42.732591 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-dcb4f3ee-3144-4860-b4b8-2cff1343c104 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.173722 Jul 28 06:39:42.738909 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 167/331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:42 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:42.773822 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-285e2947-331a-4d36-8514-c9c134ed9c21 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:42.774730 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-285e2947-331a-4d36-8514-c9c134ed9c21 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:42.781895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-285e2947-331a-4d36-8514-c9c134ed9c21 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:42.783246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-285e2947-331a-4d36-8514-c9c134ed9c21 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:42.784195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-285e2947-331a-4d36-8514-c9c134ed9c21 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:42.784626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-285e2947-331a-4d36-8514-c9c134ed9c21 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:42.954982 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-285e2947-331a-4d36-8514-c9c134ed9c21 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:42.963734 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-285e2947-331a-4d36-8514-c9c134ed9c21 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.196316 Jul 28 06:39:42.964301 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 165/332] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:42 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:43.354027 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c577c436-9c85-42fa-b3d4-478224d02975 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:43.354665 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c577c436-9c85-42fa-b3d4-478224d02975 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:43.377549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c577c436-9c85-42fa-b3d4-478224d02975 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:43.378455 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c577c436-9c85-42fa-b3d4-478224d02975 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:43.379389 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c577c436-9c85-42fa-b3d4-478224d02975 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:43.379832 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c577c436-9c85-42fa-b3d4-478224d02975 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:43.581677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c577c436-9c85-42fa-b3d4-478224d02975 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:43.593916 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c577c436-9c85-42fa-b3d4-478224d02975 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.245963 Jul 28 06:39:43.608507 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 168/333] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:43 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:43.608991 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3d65eb0f-1b78-4574-89b6-1333f65347ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:43.609896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3d65eb0f-1b78-4574-89b6-1333f65347ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:43.623263 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3d65eb0f-1b78-4574-89b6-1333f65347ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:43.623821 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3d65eb0f-1b78-4574-89b6-1333f65347ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:43.624664 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3d65eb0f-1b78-4574-89b6-1333f65347ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:43.625169 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3d65eb0f-1b78-4574-89b6-1333f65347ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:43.763128 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1bdff59e-0818-4b62-82b6-2ba66d3136aa tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:43.764960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1bdff59e-0818-4b62-82b6-2ba66d3136aa tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:43.776462 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1bdff59e-0818-4b62-82b6-2ba66d3136aa tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:43.777197 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1bdff59e-0818-4b62-82b6-2ba66d3136aa tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:43.778410 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1bdff59e-0818-4b62-82b6-2ba66d3136aa tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:43.779003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1bdff59e-0818-4b62-82b6-2ba66d3136aa tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:43.987880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1bdff59e-0818-4b62-82b6-2ba66d3136aa tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:44.001937 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1bdff59e-0818-4b62-82b6-2ba66d3136aa tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.249448 Jul 28 06:39:44.013362 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 169/334] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:43 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:44.013362 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b9c71a4e-ac86-4e1d-9f82-a90c78c0439c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:44.014413 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b9c71a4e-ac86-4e1d-9f82-a90c78c0439c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:44.025713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9c71a4e-ac86-4e1d-9f82-a90c78c0439c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:44.026484 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9c71a4e-ac86-4e1d-9f82-a90c78c0439c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:44.027794 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9c71a4e-ac86-4e1d-9f82-a90c78c0439c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:44.028470 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9c71a4e-ac86-4e1d-9f82-a90c78c0439c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:44.192910 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3d65eb0f-1b78-4574-89b6-1333f65347ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:44.207727 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3d65eb0f-1b78-4574-89b6-1333f65347ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:44.209743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3d65eb0f-1b78-4574-89b6-1333f65347ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:44.210918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3d65eb0f-1b78-4574-89b6-1333f65347ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.605815 Jul 28 06:39:44.211476 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 166/335] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:43 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:44.217459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-919b1864-8f37-4e61-b949-c76ab5cf387d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Action: 'create', calling method: .version_select at 0x7f574c1f3820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2136817802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBskmcUSyBWpxZTgZjLg9goLuI8xHNpARDR2jhp50McMctwMc7KHWw+Xl4lxoAsT319PdEVU4auf5udKStf4iqhdaRIC6iwp7L4wrdmiREGfmDo4yyZnyjTW43uG10vbQ=="}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:44.218029 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b9c71a4e-ac86-4e1d-9f82-a90c78c0439c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:44.227847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b9c71a4e-ac86-4e1d-9f82-a90c78c0439c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.218831 Jul 28 06:39:44.228556 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 170/336] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:44 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:44.236568 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-919b1864-8f37-4e61-b949-c76ab5cf387d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Getting quotas for project 6b7e4c91aaaf48e2b134128055919a47. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:39:44.240680 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-919b1864-8f37-4e61-b949-c76ab5cf387d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Getting quotas for user 93dacbaabf7343bbae337761b8d8cd41 and project 6b7e4c91aaaf48e2b134128055919a47. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:39:44.265993 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-919b1864-8f37-4e61-b949-c76ab5cf387d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053322 Jul 28 06:39:44.266627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 167/337] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Jul 28 06:39:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:44.370095 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-531808082", "imageRef": "2e19372f-703e-4030-b017-47b45173f4bf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2136817802", "networks": [{"uuid": "6d222ea2-8d19-4343-b8a9-fa254dab7a9d"}]}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:44.424959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] validate_networks() for [('6d222ea2-8d19-4343-b8a9-fa254dab7a9d', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:39:44.616419 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b93fd1f8-9740-4918-b9b7-c52bddfcd5a3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:44.617461 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b93fd1f8-9740-4918-b9b7-c52bddfcd5a3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:44.625050 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b93fd1f8-9740-4918-b9b7-c52bddfcd5a3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:44.625588 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b93fd1f8-9740-4918-b9b7-c52bddfcd5a3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:44.629313 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b93fd1f8-9740-4918-b9b7-c52bddfcd5a3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:44.630252 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b93fd1f8-9740-4918-b9b7-c52bddfcd5a3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:44.895195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b93fd1f8-9740-4918-b9b7-c52bddfcd5a3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:44.902761 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b93fd1f8-9740-4918-b9b7-c52bddfcd5a3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.290207 Jul 28 06:39:44.903326 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 168/338] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:44 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:45.028937 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-801bf696-be4a-4910-9719-575929493722 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:45.029684 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-801bf696-be4a-4910-9719-575929493722 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:45.036328 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-801bf696-be4a-4910-9719-575929493722 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:45.036776 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-801bf696-be4a-4910-9719-575929493722 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:45.037563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-801bf696-be4a-4910-9719-575929493722 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:45.038191 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-801bf696-be4a-4910-9719-575929493722 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:45.106999 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:39:45.107576 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:39:45.108046 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:39:45.108453 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:39:45.108861 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:39:45.118675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:45.119125 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:45.119921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:45.120355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:45.139511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Getting quotas for project 6b7e4c91aaaf48e2b134128055919a47. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:39:45.144284 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Getting quotas for user 93dacbaabf7343bbae337761b8d8cd41 and project 6b7e4c91aaaf48e2b134128055919a47. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:39:45.156092 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:39:45.158554 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e19372f-703e-4030-b017-47b45173f4bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:39:45.183498 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-801bf696-be4a-4910-9719-575929493722 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:45.191223 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-801bf696-be4a-4910-9719-575929493722 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.166196 Jul 28 06:39:45.191919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 169/339] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:45 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:45.207031 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-969a3ceb-437b-4ce0-bc3e-1ffd510652a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840703 Jul 28 06:39:45.207858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 171/340] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:39:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:39:45.218422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a113e09b-c2f6-4865-891d-be381adb309d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:45.219033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a113e09b-c2f6-4865-891d-be381adb309d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:45.236160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b568c177-62ee-4383-8d26-6d45f4739d68 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:45.237050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b568c177-62ee-4383-8d26-6d45f4739d68 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:45.245588 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b568c177-62ee-4383-8d26-6d45f4739d68 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:45.246017 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b568c177-62ee-4383-8d26-6d45f4739d68 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:45.246920 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b568c177-62ee-4383-8d26-6d45f4739d68 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:45.247504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b568c177-62ee-4383-8d26-6d45f4739d68 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:45.288349 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a113e09b-c2f6-4865-891d-be381adb309d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:45.296248 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a113e09b-c2f6-4865-891d-be381adb309d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1258 microversion: 2.1 time: 0.081515 Jul 28 06:39:45.297344 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 170/341] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:45 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:45.303786 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2b1f70ac-37ba-4e1e-b89d-9923d0d519f7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:45.304404 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2b1f70ac-37ba-4e1e-b89d-9923d0d519f7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:45.311468 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2b1f70ac-37ba-4e1e-b89d-9923d0d519f7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:45.311919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2b1f70ac-37ba-4e1e-b89d-9923d0d519f7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:45.312692 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2b1f70ac-37ba-4e1e-b89d-9923d0d519f7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:45.313640 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2b1f70ac-37ba-4e1e-b89d-9923d0d519f7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:45.432351 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b568c177-62ee-4383-8d26-6d45f4739d68 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:45.444560 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b568c177-62ee-4383-8d26-6d45f4739d68 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:45.446432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b568c177-62ee-4383-8d26-6d45f4739d68 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:45.447957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b568c177-62ee-4383-8d26-6d45f4739d68 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.216504 Jul 28 06:39:45.448670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 172/342] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:45 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:39:45.497682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2b1f70ac-37ba-4e1e-b89d-9923d0d519f7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:45.507865 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2b1f70ac-37ba-4e1e-b89d-9923d0d519f7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.207982 Jul 28 06:39:45.509147 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 171/343] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:45 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:45.924646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b2f03d8d-f1a6-470a-bf7e-9bce1e25f78d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:45.925745 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b2f03d8d-f1a6-470a-bf7e-9bce1e25f78d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:45.932533 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b2f03d8d-f1a6-470a-bf7e-9bce1e25f78d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:45.932975 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b2f03d8d-f1a6-470a-bf7e-9bce1e25f78d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:45.933772 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b2f03d8d-f1a6-470a-bf7e-9bce1e25f78d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:45.934204 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b2f03d8d-f1a6-470a-bf7e-9bce1e25f78d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:45.938847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:46.074849 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b2f03d8d-f1a6-470a-bf7e-9bce1e25f78d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:46.082554 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b2f03d8d-f1a6-470a-bf7e-9bce1e25f78d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.162412 Jul 28 06:39:46.083112 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 173/344] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:45 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:46.211917 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-aabf3998-c551-465a-a0f0-417e5cc24125 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:46.212517 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-aabf3998-c551-465a-a0f0-417e5cc24125 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:46.218712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aabf3998-c551-465a-a0f0-417e5cc24125 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.219851 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aabf3998-c551-465a-a0f0-417e5cc24125 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.220695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aabf3998-c551-465a-a0f0-417e5cc24125 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.221130 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aabf3998-c551-465a-a0f0-417e5cc24125 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.321375 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b7fcd889-83ec-4804-9ff0-3e22b90abfdd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:46.326233 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b7fcd889-83ec-4804-9ff0-3e22b90abfdd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:46.334867 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b7fcd889-83ec-4804-9ff0-3e22b90abfdd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.335557 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b7fcd889-83ec-4804-9ff0-3e22b90abfdd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.336328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b7fcd889-83ec-4804-9ff0-3e22b90abfdd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.336783 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b7fcd889-83ec-4804-9ff0-3e22b90abfdd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.408698 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b7fcd889-83ec-4804-9ff0-3e22b90abfdd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:46.420630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b7fcd889-83ec-4804-9ff0-3e22b90abfdd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1262 microversion: 2.1 time: 0.106666 Jul 28 06:39:46.421211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 174/345] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:46 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1262 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:46.474508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0b4cd847-5c25-40ac-aaea-081f93655c29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:46.475562 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0b4cd847-5c25-40ac-aaea-081f93655c29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:46.484774 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b4cd847-5c25-40ac-aaea-081f93655c29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.486100 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b4cd847-5c25-40ac-aaea-081f93655c29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.487132 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b4cd847-5c25-40ac-aaea-081f93655c29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.487641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b4cd847-5c25-40ac-aaea-081f93655c29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.596426 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-aabf3998-c551-465a-a0f0-417e5cc24125 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:46.604608 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-aabf3998-c551-465a-a0f0-417e5cc24125 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.396384 Jul 28 06:39:46.605348 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 172/346] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:46 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:46.610914 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-73f9443d-aae1-4060-865b-4b1430f91dd8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:46.611720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-73f9443d-aae1-4060-865b-4b1430f91dd8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:46.617862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-73f9443d-aae1-4060-865b-4b1430f91dd8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.618498 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-73f9443d-aae1-4060-865b-4b1430f91dd8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.619510 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-73f9443d-aae1-4060-865b-4b1430f91dd8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.619946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-73f9443d-aae1-4060-865b-4b1430f91dd8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.708469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0b4cd847-5c25-40ac-aaea-081f93655c29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:46.722404 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0b4cd847-5c25-40ac-aaea-081f93655c29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:46.724532 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0b4cd847-5c25-40ac-aaea-081f93655c29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:46.725763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0b4cd847-5c25-40ac-aaea-081f93655c29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.257537 Jul 28 06:39:46.729900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 175/347] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:46 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:46.911074 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-73f9443d-aae1-4060-865b-4b1430f91dd8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:46.918696 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-73f9443d-aae1-4060-865b-4b1430f91dd8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.312406 Jul 28 06:39:46.919264 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 173/348] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:46 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:47.103643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-af983c46-1593-4cc0-a9e4-908e6886b6bb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:47.104163 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-af983c46-1593-4cc0-a9e4-908e6886b6bb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:47.111256 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-af983c46-1593-4cc0-a9e4-908e6886b6bb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:47.111706 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-af983c46-1593-4cc0-a9e4-908e6886b6bb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.112481 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-af983c46-1593-4cc0-a9e4-908e6886b6bb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:47.112922 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-af983c46-1593-4cc0-a9e4-908e6886b6bb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.247908 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-af983c46-1593-4cc0-a9e4-908e6886b6bb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:47.256617 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-af983c46-1593-4cc0-a9e4-908e6886b6bb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.156652 Jul 28 06:39:47.257503 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 176/349] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:47 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:47.443401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-472353a7-6825-45fd-a77a-8092df4d1f8c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:47.444260 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-472353a7-6825-45fd-a77a-8092df4d1f8c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:47.450410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-472353a7-6825-45fd-a77a-8092df4d1f8c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:47.450848 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-472353a7-6825-45fd-a77a-8092df4d1f8c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.451608 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-472353a7-6825-45fd-a77a-8092df4d1f8c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:47.452044 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-472353a7-6825-45fd-a77a-8092df4d1f8c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.515311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-472353a7-6825-45fd-a77a-8092df4d1f8c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:47.522826 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-472353a7-6825-45fd-a77a-8092df4d1f8c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1310 microversion: 2.1 time: 0.083337 Jul 28 06:39:47.523401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 174/350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:47 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:47.626608 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e530e361-d943-4953-b850-fd7cc363420d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:47.628222 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e530e361-d943-4953-b850-fd7cc363420d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:47.633950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e530e361-d943-4953-b850-fd7cc363420d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:47.634403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e530e361-d943-4953-b850-fd7cc363420d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.635171 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e530e361-d943-4953-b850-fd7cc363420d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:47.635608 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e530e361-d943-4953-b850-fd7cc363420d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.750688 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-abf4bea8-9629-4d37-b11c-0babd0a92511 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:47.753776 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-abf4bea8-9629-4d37-b11c-0babd0a92511 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:47.760515 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-abf4bea8-9629-4d37-b11c-0babd0a92511 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:47.761231 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-abf4bea8-9629-4d37-b11c-0babd0a92511 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.762269 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-abf4bea8-9629-4d37-b11c-0babd0a92511 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:47.762898 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-abf4bea8-9629-4d37-b11c-0babd0a92511 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.784591 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e530e361-d943-4953-b850-fd7cc363420d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:47.796347 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e530e361-d943-4953-b850-fd7cc363420d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.172468 Jul 28 06:39:47.798299 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 177/351] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:47 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:47.940782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8ce395d4-0daf-4cd1-8073-0dbeb18fa818 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:47.941586 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8ce395d4-0daf-4cd1-8073-0dbeb18fa818 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:47.948760 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ce395d4-0daf-4cd1-8073-0dbeb18fa818 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:47.949214 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ce395d4-0daf-4cd1-8073-0dbeb18fa818 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.950271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ce395d4-0daf-4cd1-8073-0dbeb18fa818 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:47.950724 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ce395d4-0daf-4cd1-8073-0dbeb18fa818 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.969896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-abf4bea8-9629-4d37-b11c-0babd0a92511 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:47.978845 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-abf4bea8-9629-4d37-b11c-0babd0a92511 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:47.980374 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-abf4bea8-9629-4d37-b11c-0babd0a92511 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:47.981700 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-abf4bea8-9629-4d37-b11c-0babd0a92511 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.235168 Jul 28 06:39:47.982847 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 175/352] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:47 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:48.028511 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-4079dc3b-b672-44e8-99ef-b4263f930f0c req-ab254b75-3bff-4e0c-ba54-3608cbfae69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c8cbe2-7d60-4ddb-b580-02fd7b8d7148", "name": "network-vif-plugged", "status": "completed", "tag": "3e5d434a-57c7-43e3-a3af-c419d61fcc19"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:48.043213 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-4079dc3b-b672-44e8-99ef-b4263f930f0c req-ab254b75-3bff-4e0c-ba54-3608cbfae69a service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:48.044335 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-4079dc3b-b672-44e8-99ef-b4263f930f0c req-ab254b75-3bff-4e0c-ba54-3608cbfae69a service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:48.063046 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-4079dc3b-b672-44e8-99ef-b4263f930f0c req-ab254b75-3bff-4e0c-ba54-3608cbfae69a service nova] Creating event network-vif-plugged:3e5d434a-57c7-43e3-a3af-c419d61fcc19 for instance 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 on hv-cinder-85060 Jul 28 06:39:48.068844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-4079dc3b-b672-44e8-99ef-b4263f930f0c req-ab254b75-3bff-4e0c-ba54-3608cbfae69a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044378 Jul 28 06:39:48.069479 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 176/353] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:39:48.101038 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8ce395d4-0daf-4cd1-8073-0dbeb18fa818 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:48.109055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8ce395d4-0daf-4cd1-8073-0dbeb18fa818 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.173117 Jul 28 06:39:48.109638 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 178/354] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:47 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:48.280081 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-787c49ab-90eb-469f-8760-1b7f35371ceb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:48.280797 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-787c49ab-90eb-469f-8760-1b7f35371ceb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:48.287875 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-787c49ab-90eb-469f-8760-1b7f35371ceb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:48.288326 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-787c49ab-90eb-469f-8760-1b7f35371ceb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:48.289100 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-787c49ab-90eb-469f-8760-1b7f35371ceb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:48.289583 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-787c49ab-90eb-469f-8760-1b7f35371ceb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:48.308928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:48.436634 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-787c49ab-90eb-469f-8760-1b7f35371ceb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:48.445108 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-787c49ab-90eb-469f-8760-1b7f35371ceb tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.169441 Jul 28 06:39:48.445717 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 177/355] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:48 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:48.544140 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2a636b33-c324-4001-889e-fadd53c5bdfa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:48.544665 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2a636b33-c324-4001-889e-fadd53c5bdfa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:48.552075 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2a636b33-c324-4001-889e-fadd53c5bdfa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:48.552535 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2a636b33-c324-4001-889e-fadd53c5bdfa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:48.553319 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2a636b33-c324-4001-889e-fadd53c5bdfa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:48.553770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2a636b33-c324-4001-889e-fadd53c5bdfa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:48.619293 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2a636b33-c324-4001-889e-fadd53c5bdfa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:48.627643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2a636b33-c324-4001-889e-fadd53c5bdfa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1328 microversion: 2.1 time: 0.087439 Jul 28 06:39:48.628253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 179/356] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:48 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1328 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:48.819031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3482e772-bd84-400f-a226-00fa801e2ed5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:48.819547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3482e772-bd84-400f-a226-00fa801e2ed5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:48.825645 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3482e772-bd84-400f-a226-00fa801e2ed5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:48.826094 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3482e772-bd84-400f-a226-00fa801e2ed5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:48.826854 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3482e772-bd84-400f-a226-00fa801e2ed5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:48.827287 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3482e772-bd84-400f-a226-00fa801e2ed5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:48.969924 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3482e772-bd84-400f-a226-00fa801e2ed5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:48.978794 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3482e772-bd84-400f-a226-00fa801e2ed5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.164409 Jul 28 06:39:48.979364 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 178/357] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:48 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:49.006437 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c8c0324f-e0d1-4345-ade4-b6e9e4675907 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:49.007046 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c8c0324f-e0d1-4345-ade4-b6e9e4675907 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:49.013111 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8c0324f-e0d1-4345-ade4-b6e9e4675907 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:49.013591 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8c0324f-e0d1-4345-ade4-b6e9e4675907 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:49.014348 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8c0324f-e0d1-4345-ade4-b6e9e4675907 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:49.014784 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8c0324f-e0d1-4345-ade4-b6e9e4675907 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:49.132318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f769e3c5-f483-4f06-987f-36a94b0065d8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:49.132919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f769e3c5-f483-4f06-987f-36a94b0065d8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:49.140593 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f769e3c5-f483-4f06-987f-36a94b0065d8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:49.141053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f769e3c5-f483-4f06-987f-36a94b0065d8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:49.141881 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f769e3c5-f483-4f06-987f-36a94b0065d8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:49.142893 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f769e3c5-f483-4f06-987f-36a94b0065d8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:49.157511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c8c0324f-e0d1-4345-ade4-b6e9e4675907 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:49.167536 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c8c0324f-e0d1-4345-ade4-b6e9e4675907 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:49.169328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c8c0324f-e0d1-4345-ade4-b6e9e4675907 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:49.172202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c8c0324f-e0d1-4345-ade4-b6e9e4675907 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.169067 Jul 28 06:39:49.173409 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 180/358] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:49 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:49.381246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f769e3c5-f483-4f06-987f-36a94b0065d8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:49.392185 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f769e3c5-f483-4f06-987f-36a94b0065d8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.263294 Jul 28 06:39:49.405321 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 179/359] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:49 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:49.466011 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6db21370-b54b-4218-a418-0bb839dad5cd tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:49.473217 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6db21370-b54b-4218-a418-0bb839dad5cd tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:49.475471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6db21370-b54b-4218-a418-0bb839dad5cd tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:49.475471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6db21370-b54b-4218-a418-0bb839dad5cd tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:49.475719 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6db21370-b54b-4218-a418-0bb839dad5cd tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:49.476179 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6db21370-b54b-4218-a418-0bb839dad5cd tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:49.622147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6db21370-b54b-4218-a418-0bb839dad5cd tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:49.629898 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6db21370-b54b-4218-a418-0bb839dad5cd tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.167743 Jul 28 06:39:49.641333 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 181/360] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:49 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:49.648816 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-fb8db43a-427e-4716-a8c1-018a2af7155d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:49.649664 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-fb8db43a-427e-4716-a8c1-018a2af7155d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:49.655612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fb8db43a-427e-4716-a8c1-018a2af7155d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:49.656062 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fb8db43a-427e-4716-a8c1-018a2af7155d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:49.656835 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fb8db43a-427e-4716-a8c1-018a2af7155d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:49.657488 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fb8db43a-427e-4716-a8c1-018a2af7155d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:49.731318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-fb8db43a-427e-4716-a8c1-018a2af7155d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:49.739496 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-fb8db43a-427e-4716-a8c1-018a2af7155d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1316 microversion: 2.1 time: 0.094397 Jul 28 06:39:49.740284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 180/361] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:49 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:50.000881 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7255088a-a196-46fd-9c92-8e655a6e1dc9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:50.002168 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7255088a-a196-46fd-9c92-8e655a6e1dc9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:50.008270 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7255088a-a196-46fd-9c92-8e655a6e1dc9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.008717 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7255088a-a196-46fd-9c92-8e655a6e1dc9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.009696 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7255088a-a196-46fd-9c92-8e655a6e1dc9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.010136 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7255088a-a196-46fd-9c92-8e655a6e1dc9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.147811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7255088a-a196-46fd-9c92-8e655a6e1dc9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:50.158581 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7255088a-a196-46fd-9c92-8e655a6e1dc9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1501 microversion: 2.1 time: 0.159791 Jul 28 06:39:50.159266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 182/362] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:49 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:50.184565 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-534a7ac7-ff03-48b9-a329-c7634210d782 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00da3c1f-25db-4984-8c89-85e40bd4d16b"}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:50.188150 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-534a7ac7-ff03-48b9-a329-c7634210d782 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:50.195601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-534a7ac7-ff03-48b9-a329-c7634210d782 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.196325 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-534a7ac7-ff03-48b9-a329-c7634210d782 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.197311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-534a7ac7-ff03-48b9-a329-c7634210d782 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.197778 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-534a7ac7-ff03-48b9-a329-c7634210d782 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.198931 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-80861d30-26e9-4797-a131-9bbe1109f8bd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:50.199710 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-80861d30-26e9-4797-a131-9bbe1109f8bd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:50.207309 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-80861d30-26e9-4797-a131-9bbe1109f8bd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.207766 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-80861d30-26e9-4797-a131-9bbe1109f8bd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.208575 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-80861d30-26e9-4797-a131-9bbe1109f8bd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.208991 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-80861d30-26e9-4797-a131-9bbe1109f8bd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.224207 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-534a7ac7-ff03-48b9-a329-c7634210d782 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] HTTP exception thrown: Cannot 'attach_volume' instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 while it is in vm_state rescued Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-534a7ac7-ff03-48b9-a329-c7634210d782 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Request method failure captured: Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: POST /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3/os-volume_attachments HTTP/1.1 Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 74 Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6gL3NkHM14I48tiw5dWARRiVlSX6hjzNDYLhrttt-VpWAx6eXR5kUxZBDUlxCkX-fjq73lfPcjtweW5Eo4lRq0y_dlqVzl41Z6FONmvJzGg1r1nfLlC1eo1-rYp9LQrqHOfMHzFaI4teQM8o0fNLhLpKdrVeIXiaMq8dsMMjOvMfQ Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: 0fb2f4ad616e43f5a9a248390bd0aebf Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:39:50.226293 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fb2f4ad616e43f5a9a248390bd0aebf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fb2f4ad616e43f5a9a248390bd0aebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fb2f4ad616e43f5a9a248390bd0aebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fb2f4ad616e43f5a9a248390bd0aebf"}]}] Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: 0fb2f4ad616e43f5a9a248390bd0aebf Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-ServerRescueNegativeTestJSON-690058944-project Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: a2080efc6cbd471995593012bc268765 Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690058944-project Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {"volumeAttachment": {"volumeId": "00da3c1f-25db-4984-8c89-85e40bd4d16b"}} Jul 28 06:39:50.227670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Cannot 'attach_volume' instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 while it is in vm_state rescued Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'server_id': '759d9d29-e67f-49e4-986a-5d71340fd0c3', 'body': {'volumeAttachment': {'volumeId': '00da3c1f-25db-4984-8c89-85e40bd4d16b'}}} Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:39:50.228459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 while it is in vm_state rescued Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:50.229840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:50.231235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:39:50.231235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:39:50.231235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 while it is in vm_state rescued Jul 28 06:39:50.231235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:39:50.231235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-534a7ac7-ff03-48b9-a329-c7634210d782 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Returning 409 to user: Cannot 'attach_volume' instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 while it is in vm_state rescued {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:39:50.231235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-534a7ac7-ff03-48b9-a329-c7634210d782 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050122 Jul 28 06:39:50.231235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 181/363] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:39:50 2022] POST /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 06:39:50.237380 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-56ed1126-35c7-4b51-b0a5-9d19dc57504e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:50.237906 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-56ed1126-35c7-4b51-b0a5-9d19dc57504e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:50.244103 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56ed1126-35c7-4b51-b0a5-9d19dc57504e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.244540 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56ed1126-35c7-4b51-b0a5-9d19dc57504e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.245324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56ed1126-35c7-4b51-b0a5-9d19dc57504e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.245771 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56ed1126-35c7-4b51-b0a5-9d19dc57504e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.321861 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-56ed1126-35c7-4b51-b0a5-9d19dc57504e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3/action" status: 202 len: 0 microversion: 2.1 time: 0.088599 Jul 28 06:39:50.322559 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 182/364] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:39:50 2022] POST /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:39:50.332807 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9e3b848b-8c41-4195-a7c6-a65ce7ae7ecb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:50.333950 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9e3b848b-8c41-4195-a7c6-a65ce7ae7ecb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:50.341979 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e3b848b-8c41-4195-a7c6-a65ce7ae7ecb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.342423 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e3b848b-8c41-4195-a7c6-a65ce7ae7ecb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.343221 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e3b848b-8c41-4195-a7c6-a65ce7ae7ecb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.343662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e3b848b-8c41-4195-a7c6-a65ce7ae7ecb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.368559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-80861d30-26e9-4797-a131-9bbe1109f8bd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:50.376545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-80861d30-26e9-4797-a131-9bbe1109f8bd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:50.379062 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-80861d30-26e9-4797-a131-9bbe1109f8bd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:50.380242 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-80861d30-26e9-4797-a131-9bbe1109f8bd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.185479 Jul 28 06:39:50.380846 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 183/365] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:50 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:50.428308 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-fa5320f6-c209-4686-9e6c-7406ce62ca3d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:50.428852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-fa5320f6-c209-4686-9e6c-7406ce62ca3d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:50.435021 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa5320f6-c209-4686-9e6c-7406ce62ca3d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.435475 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa5320f6-c209-4686-9e6c-7406ce62ca3d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.436264 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa5320f6-c209-4686-9e6c-7406ce62ca3d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.436709 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa5320f6-c209-4686-9e6c-7406ce62ca3d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.506462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9e3b848b-8c41-4195-a7c6-a65ce7ae7ecb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:50.528856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9e3b848b-8c41-4195-a7c6-a65ce7ae7ecb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.201656 Jul 28 06:39:50.529459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 183/366] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:50 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:50.585072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-fa5320f6-c209-4686-9e6c-7406ce62ca3d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:50.592475 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-fa5320f6-c209-4686-9e6c-7406ce62ca3d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.168987 Jul 28 06:39:50.593022 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 184/367] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:50 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:50.651157 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a6d52a23-36a0-48ae-a203-5a2fd03b8441 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:50.651769 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a6d52a23-36a0-48ae-a203-5a2fd03b8441 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:50.657833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a6d52a23-36a0-48ae-a203-5a2fd03b8441 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.658361 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a6d52a23-36a0-48ae-a203-5a2fd03b8441 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.659131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a6d52a23-36a0-48ae-a203-5a2fd03b8441 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.659563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a6d52a23-36a0-48ae-a203-5a2fd03b8441 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.760535 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e731603f-2832-481c-82cc-ef6078c6ea9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:50.761428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e731603f-2832-481c-82cc-ef6078c6ea9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:50.768118 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e731603f-2832-481c-82cc-ef6078c6ea9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.768846 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e731603f-2832-481c-82cc-ef6078c6ea9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.769701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e731603f-2832-481c-82cc-ef6078c6ea9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.770142 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e731603f-2832-481c-82cc-ef6078c6ea9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.795404 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a6d52a23-36a0-48ae-a203-5a2fd03b8441 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:50.803857 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a6d52a23-36a0-48ae-a203-5a2fd03b8441 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.156624 Jul 28 06:39:50.804452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 184/368] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:50 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:50.909616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e731603f-2832-481c-82cc-ef6078c6ea9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:50.917174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e731603f-2832-481c-82cc-ef6078c6ea9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.161167 Jul 28 06:39:50.917768 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 185/369] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:50 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:51.403038 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-56240155-4576-48e4-8d82-ae7e5626b69c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:51.403637 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-56240155-4576-48e4-8d82-ae7e5626b69c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:51.410398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56240155-4576-48e4-8d82-ae7e5626b69c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.410829 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56240155-4576-48e4-8d82-ae7e5626b69c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.411613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56240155-4576-48e4-8d82-ae7e5626b69c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.412042 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56240155-4576-48e4-8d82-ae7e5626b69c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.550047 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-67770820-0e67-4250-903a-ad040e38504a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:51.550727 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-67770820-0e67-4250-903a-ad040e38504a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:51.557804 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67770820-0e67-4250-903a-ad040e38504a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.558646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67770820-0e67-4250-903a-ad040e38504a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.559783 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67770820-0e67-4250-903a-ad040e38504a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.560969 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67770820-0e67-4250-903a-ad040e38504a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.727519 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-67770820-0e67-4250-903a-ad040e38504a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:51.734846 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-67770820-0e67-4250-903a-ad040e38504a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.188687 Jul 28 06:39:51.735409 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 186/370] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:51 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:51.740858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-085f28e4-47a7-4157-95d5-5298cc5d6872 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:51.741039 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-56240155-4576-48e4-8d82-ae7e5626b69c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:51.741508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-085f28e4-47a7-4157-95d5-5298cc5d6872 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:51.749456 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-56240155-4576-48e4-8d82-ae7e5626b69c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:51.751287 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-56240155-4576-48e4-8d82-ae7e5626b69c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:51.753284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-56240155-4576-48e4-8d82-ae7e5626b69c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.353612 Jul 28 06:39:51.753847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-085f28e4-47a7-4157-95d5-5298cc5d6872 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.754303 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-085f28e4-47a7-4157-95d5-5298cc5d6872 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.754525 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 185/371] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:51 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:51.755097 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-085f28e4-47a7-4157-95d5-5298cc5d6872 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.755538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-085f28e4-47a7-4157-95d5-5298cc5d6872 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.759916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f98419d2-4c53-4961-ba12-c60b9cd6b59b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: .version_select at 0x7f574c0f2700>, body: {"keypair": {"name": "tempest-keypair-1496733716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ctztj5RfV0A7g2VDMJ2pam61Gurl+ZzyMVweElzqHn6hMncs7trMRSo5255WEco0sPfDJIuRx0vrebVZoo4siNPFHAqq1hqqyjB1q1xRNUNIvkc3+rXaDt3RdfWkOOw=="}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:51.776493 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-f98419d2-4c53-4961-ba12-c60b9cd6b59b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:39:51.780375 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-f98419d2-4c53-4961-ba12-c60b9cd6b59b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for user 4a1db92e28444854b9de817dd36104ea and project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:39:51.809129 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f98419d2-4c53-4961-ba12-c60b9cd6b59b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052753 Jul 28 06:39:51.813372 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 186/372] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Jul 28 06:39:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:51.825163 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-eba4e292-9081-4d90-8895-a8ef4c66de9f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:51.825999 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-eba4e292-9081-4d90-8895-a8ef4c66de9f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:51.834346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-eba4e292-9081-4d90-8895-a8ef4c66de9f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.834791 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-eba4e292-9081-4d90-8895-a8ef4c66de9f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.835612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-eba4e292-9081-4d90-8895-a8ef4c66de9f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.836058 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-eba4e292-9081-4d90-8895-a8ef4c66de9f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.917569 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-085f28e4-47a7-4157-95d5-5298cc5d6872 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:51.925603 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-085f28e4-47a7-4157-95d5-5298cc5d6872 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.188846 Jul 28 06:39:51.926431 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 187/373] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:51 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:51.939457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-08ab52e2-16c9-4cbf-9b7e-c1becbbe32f7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:51.940107 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-08ab52e2-16c9-4cbf-9b7e-c1becbbe32f7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:51.946329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-08ab52e2-16c9-4cbf-9b7e-c1becbbe32f7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.946880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-08ab52e2-16c9-4cbf-9b7e-c1becbbe32f7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.947527 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-08ab52e2-16c9-4cbf-9b7e-c1becbbe32f7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.947955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-08ab52e2-16c9-4cbf-9b7e-c1becbbe32f7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:52.108190 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-08ab52e2-16c9-4cbf-9b7e-c1becbbe32f7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:52.117164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-08ab52e2-16c9-4cbf-9b7e-c1becbbe32f7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.181968 Jul 28 06:39:52.121338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 188/374] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:51 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:52.152935 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-eba4e292-9081-4d90-8895-a8ef4c66de9f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:52.162470 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-eba4e292-9081-4d90-8895-a8ef4c66de9f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.341934 Jul 28 06:39:52.163048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 187/375] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:51 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:52.329909 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-e4cd829b-45b7-4d0a-8ebe-a487cc15031a req-78d2c30c-0ca3-4ac6-b908-66ec12d5c67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9e64be-7751-4a35-9913-759b5aa65387", "tag": "547ddf0c-06c1-4016-890a-f31d53cfe707"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:52.340856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-e4cd829b-45b7-4d0a-8ebe-a487cc15031a req-78d2c30c-0ca3-4ac6-b908-66ec12d5c67e service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:52.345490 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-e4cd829b-45b7-4d0a-8ebe-a487cc15031a req-78d2c30c-0ca3-4ac6-b908-66ec12d5c67e service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:52.360421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-e4cd829b-45b7-4d0a-8ebe-a487cc15031a req-78d2c30c-0ca3-4ac6-b908-66ec12d5c67e service nova] Creating event network-changed:547ddf0c-06c1-4016-890a-f31d53cfe707 for instance 3e9e64be-7751-4a35-9913-759b5aa65387 on hv-cinder-85060 Jul 28 06:39:52.368342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-e4cd829b-45b7-4d0a-8ebe-a487cc15031a req-78d2c30c-0ca3-4ac6-b908-66ec12d5c67e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041785 Jul 28 06:39:52.369622 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 189/376] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:52.756492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6f880481-3d44-417a-ac68-009af757d7be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:52.757107 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6f880481-3d44-417a-ac68-009af757d7be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:52.763966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6f880481-3d44-417a-ac68-009af757d7be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:52.764521 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6f880481-3d44-417a-ac68-009af757d7be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:52.765401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6f880481-3d44-417a-ac68-009af757d7be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:52.766177 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6f880481-3d44-417a-ac68-009af757d7be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:52.780643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-049340f4-1120-4dc2-9e62-b63921bad906 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:52.781373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-049340f4-1120-4dc2-9e62-b63921bad906 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:52.789954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-049340f4-1120-4dc2-9e62-b63921bad906 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:52.790414 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-049340f4-1120-4dc2-9e62-b63921bad906 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:52.791340 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-049340f4-1120-4dc2-9e62-b63921bad906 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:52.791784 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-049340f4-1120-4dc2-9e62-b63921bad906 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:52.809873 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:52.934525 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-049340f4-1120-4dc2-9e62-b63921bad906 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:52.949195 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-049340f4-1120-4dc2-9e62-b63921bad906 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:52.951219 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-049340f4-1120-4dc2-9e62-b63921bad906 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:52.952525 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-049340f4-1120-4dc2-9e62-b63921bad906 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.176811 Jul 28 06:39:52.953149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 190/377] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:52 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:39:52.958250 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-510fe4f7-f778-419e-8506-6100e9e6d2ff tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:52.958922 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-510fe4f7-f778-419e-8506-6100e9e6d2ff tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:52.965077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-510fe4f7-f778-419e-8506-6100e9e6d2ff tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:52.965615 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-510fe4f7-f778-419e-8506-6100e9e6d2ff tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:52.966454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-510fe4f7-f778-419e-8506-6100e9e6d2ff tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:52.966952 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-510fe4f7-f778-419e-8506-6100e9e6d2ff tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:53.087961 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6f880481-3d44-417a-ac68-009af757d7be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:53.098371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6f880481-3d44-417a-ac68-009af757d7be tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.345824 Jul 28 06:39:53.114492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 188/378] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:52 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:53.115307 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-510fe4f7-f778-419e-8506-6100e9e6d2ff tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:53.123863 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-510fe4f7-f778-419e-8506-6100e9e6d2ff tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.169596 Jul 28 06:39:53.136515 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 191/379] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:52 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:53.142984 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-69aface3-94e0-4ac5-9beb-61b0d2f659f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:53.143873 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-69aface3-94e0-4ac5-9beb-61b0d2f659f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:53.152203 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-69aface3-94e0-4ac5-9beb-61b0d2f659f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:53.152793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-69aface3-94e0-4ac5-9beb-61b0d2f659f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:53.153620 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-69aface3-94e0-4ac5-9beb-61b0d2f659f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:53.154051 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-69aface3-94e0-4ac5-9beb-61b0d2f659f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:53.184596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-149dbe27-7a76-4561-826f-36a86603e79b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:53.187589 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-149dbe27-7a76-4561-826f-36a86603e79b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:53.199139 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-149dbe27-7a76-4561-826f-36a86603e79b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:53.199564 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-149dbe27-7a76-4561-826f-36a86603e79b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:53.200337 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-149dbe27-7a76-4561-826f-36a86603e79b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:53.201964 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-149dbe27-7a76-4561-826f-36a86603e79b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:53.350213 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-149dbe27-7a76-4561-826f-36a86603e79b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:53.358613 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-149dbe27-7a76-4561-826f-36a86603e79b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.178129 Jul 28 06:39:53.374950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 192/380] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:53 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:53.474801 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-69aface3-94e0-4ac5-9beb-61b0d2f659f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:53.481045 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-69aface3-94e0-4ac5-9beb-61b0d2f659f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.344350 Jul 28 06:39:53.481816 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 189/381] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:53 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:53.976480 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5f0d3581-a2b7-4108-acee-325642748530 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:53.977269 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5f0d3581-a2b7-4108-acee-325642748530 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:53.984292 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5f0d3581-a2b7-4108-acee-325642748530 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:53.984881 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5f0d3581-a2b7-4108-acee-325642748530 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:53.985791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5f0d3581-a2b7-4108-acee-325642748530 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:53.986334 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5f0d3581-a2b7-4108-acee-325642748530 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:54.042831 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-967475245", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1658fcaf-8835-445a-a4cf-3f4534b3861e"}], "security_groups": [{"name": "tempest-securitygroup--1160594412"}], "key_name": "tempest-keypair-1496733716", "user_data": "}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:54.134953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5f0d3581-a2b7-4108-acee-325642748530 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:54.144137 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5f0d3581-a2b7-4108-acee-325642748530 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:54.145670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5f0d3581-a2b7-4108-acee-325642748530 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:54.146918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5f0d3581-a2b7-4108-acee-325642748530 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.174313 Jul 28 06:39:54.147474 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 193/382] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:53 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:54.152042 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0f03299a-ac82-4e36-9452-2e5fab9069de tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:54.152640 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0f03299a-ac82-4e36-9452-2e5fab9069de tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:54.159451 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0f03299a-ac82-4e36-9452-2e5fab9069de tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:54.159849 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0f03299a-ac82-4e36-9452-2e5fab9069de tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:54.160794 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0f03299a-ac82-4e36-9452-2e5fab9069de tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:54.161230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0f03299a-ac82-4e36-9452-2e5fab9069de tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:54.305615 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0f03299a-ac82-4e36-9452-2e5fab9069de tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:54.312936 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0f03299a-ac82-4e36-9452-2e5fab9069de tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.164413 Jul 28 06:39:54.313510 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 194/383] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:54 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:54.318046 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c96c1ebd-2824-4b42-9bc1-21c4e463540b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:54.318890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c96c1ebd-2824-4b42-9bc1-21c4e463540b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:54.324363 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c96c1ebd-2824-4b42-9bc1-21c4e463540b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:54.324810 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c96c1ebd-2824-4b42-9bc1-21c4e463540b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:54.325591 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c96c1ebd-2824-4b42-9bc1-21c4e463540b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:54.326020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c96c1ebd-2824-4b42-9bc1-21c4e463540b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:54.457828 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c96c1ebd-2824-4b42-9bc1-21c4e463540b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:54.465377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c96c1ebd-2824-4b42-9bc1-21c4e463540b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.150901 Jul 28 06:39:54.466154 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 195/384] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:54 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:54.470329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-19929e90-8917-42ce-bb9a-60f57c515f1c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:54.470936 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-19929e90-8917-42ce-bb9a-60f57c515f1c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:54.478086 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-19929e90-8917-42ce-bb9a-60f57c515f1c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:54.478757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-19929e90-8917-42ce-bb9a-60f57c515f1c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:54.479923 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-19929e90-8917-42ce-bb9a-60f57c515f1c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:54.480585 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-19929e90-8917-42ce-bb9a-60f57c515f1c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:54.632191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-19929e90-8917-42ce-bb9a-60f57c515f1c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:54.639688 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-19929e90-8917-42ce-bb9a-60f57c515f1c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1313 microversion: 2.1 time: 0.172787 Jul 28 06:39:54.640256 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 196/385] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:54 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:54.655036 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6665a31a-b78b-4f19-99fb-7427a0253eaa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:54.655869 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6665a31a-b78b-4f19-99fb-7427a0253eaa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:54.662900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6665a31a-b78b-4f19-99fb-7427a0253eaa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:54.663329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6665a31a-b78b-4f19-99fb-7427a0253eaa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:54.664114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6665a31a-b78b-4f19-99fb-7427a0253eaa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:54.664544 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6665a31a-b78b-4f19-99fb-7427a0253eaa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:54.800656 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6665a31a-b78b-4f19-99fb-7427a0253eaa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:54.808176 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6665a31a-b78b-4f19-99fb-7427a0253eaa tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.157203 Jul 28 06:39:54.808828 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 197/386] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:54 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:54.879693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.network.neutron [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] validate_networks() for [('1658fcaf-8835-445a-a4cf-3f4534b3861e', None, None, None, None, None)] {{(pid=124562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:39:55.184103 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b6f9b6d0-2d3f-4c21-a35f-40cda0096afe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:55.184777 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b6f9b6d0-2d3f-4c21-a35f-40cda0096afe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:55.187327 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=6 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:55.188122 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=20 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:55.195375 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b6f9b6d0-2d3f-4c21-a35f-40cda0096afe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.195829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b6f9b6d0-2d3f-4c21-a35f-40cda0096afe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.196600 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b6f9b6d0-2d3f-4c21-a35f-40cda0096afe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.197037 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b6f9b6d0-2d3f-4c21-a35f-40cda0096afe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.351649 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b6f9b6d0-2d3f-4c21-a35f-40cda0096afe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:55.360509 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b6f9b6d0-2d3f-4c21-a35f-40cda0096afe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:55.362512 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b6f9b6d0-2d3f-4c21-a35f-40cda0096afe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:55.363827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b6f9b6d0-2d3f-4c21-a35f-40cda0096afe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.183664 Jul 28 06:39:55.365271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 198/387] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:55 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:39:55.372408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5d42ad1b-7f62-43ad-91fe-1ce9de1f47f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:55.373235 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5d42ad1b-7f62-43ad-91fe-1ce9de1f47f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:55.380932 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5d42ad1b-7f62-43ad-91fe-1ce9de1f47f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.380932 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5d42ad1b-7f62-43ad-91fe-1ce9de1f47f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.381703 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5d42ad1b-7f62-43ad-91fe-1ce9de1f47f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.382469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5d42ad1b-7f62-43ad-91fe-1ce9de1f47f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.416788 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Flavor limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:39:55.417267 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Image limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:39:55.417826 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Flavor pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:39:55.418299 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Image pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:39:55.418843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:39:55.429327 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.429781 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.430628 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.431057 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.451330 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:39:55.455458 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for user 4a1db92e28444854b9de817dd36104ea and project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:39:55.467277 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Going to run 1 instances... {{(pid=124562) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:39:55.469553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:39:55.521672 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-26eea900-b8f7-4584-b4ef-22332d487fe5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.482985 Jul 28 06:39:55.522319 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 190/388] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:39:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:39:55.524073 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5d42ad1b-7f62-43ad-91fe-1ce9de1f47f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:55.526746 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-49d56744-f002-439b-873c-4e82e3a1e77e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:55.527350 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-49d56744-f002-439b-873c-4e82e3a1e77e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:55.534290 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5d42ad1b-7f62-43ad-91fe-1ce9de1f47f0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.167313 Jul 28 06:39:55.534519 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-49d56744-f002-439b-873c-4e82e3a1e77e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.534744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-49d56744-f002-439b-873c-4e82e3a1e77e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.535626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-49d56744-f002-439b-873c-4e82e3a1e77e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.535737 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 199/389] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:55 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:55.536064 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-49d56744-f002-439b-873c-4e82e3a1e77e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.540445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e39dd709-690d-4b15-ac54-4883fff5178b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:55.541045 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e39dd709-690d-4b15-ac54-4883fff5178b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:55.598900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e39dd709-690d-4b15-ac54-4883fff5178b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:55.605800 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e39dd709-690d-4b15-ac54-4883fff5178b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1241 microversion: 2.1 time: 0.068862 Jul 28 06:39:55.607178 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 200/390] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:55 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:55.662747 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8b90cdee-54c7-4f16-af3e-3a99b46a508d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:55.663250 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8b90cdee-54c7-4f16-af3e-3a99b46a508d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:55.670494 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8b90cdee-54c7-4f16-af3e-3a99b46a508d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.670946 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8b90cdee-54c7-4f16-af3e-3a99b46a508d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.671791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8b90cdee-54c7-4f16-af3e-3a99b46a508d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.672325 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8b90cdee-54c7-4f16-af3e-3a99b46a508d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.701962 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-49d56744-f002-439b-873c-4e82e3a1e77e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:55.712996 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-49d56744-f002-439b-873c-4e82e3a1e77e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.189571 Jul 28 06:39:55.718687 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 191/391] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:55 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:55.816921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8b90cdee-54c7-4f16-af3e-3a99b46a508d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:55.828549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8b90cdee-54c7-4f16-af3e-3a99b46a508d tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1498 microversion: 2.1 time: 0.170569 Jul 28 06:39:55.829128 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e8aee84f-5793-47a0-a351-3a45e9adbd64 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:55.829844 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 201/392] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:55 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:55.830292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e8aee84f-5793-47a0-a351-3a45e9adbd64 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:55.834579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:55.839479 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e8aee84f-5793-47a0-a351-3a45e9adbd64 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.840161 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e8aee84f-5793-47a0-a351-3a45e9adbd64 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:55.841249 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e8aee84f-5793-47a0-a351-3a45e9adbd64 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:55.841927 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e8aee84f-5793-47a0-a351-3a45e9adbd64 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:56.093454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e8aee84f-5793-47a0-a351-3a45e9adbd64 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:56.104133 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e8aee84f-5793-47a0-a351-3a45e9adbd64 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.278037 Jul 28 06:39:56.110047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 192/393] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:55 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:56.387039 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2d1feb3c-5688-4b7d-baf7-2e5cfb031159 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:56.388199 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2d1feb3c-5688-4b7d-baf7-2e5cfb031159 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:56.401922 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d1feb3c-5688-4b7d-baf7-2e5cfb031159 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:56.402346 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d1feb3c-5688-4b7d-baf7-2e5cfb031159 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:56.403143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d1feb3c-5688-4b7d-baf7-2e5cfb031159 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:56.403572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d1feb3c-5688-4b7d-baf7-2e5cfb031159 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:56.557214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ff04819b-53b7-4069-b037-c2e53838873d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:56.557845 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ff04819b-53b7-4069-b037-c2e53838873d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:56.565644 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff04819b-53b7-4069-b037-c2e53838873d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:56.572486 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff04819b-53b7-4069-b037-c2e53838873d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:56.574086 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff04819b-53b7-4069-b037-c2e53838873d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:56.574931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ff04819b-53b7-4069-b037-c2e53838873d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:56.653447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d1feb3c-5688-4b7d-baf7-2e5cfb031159 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:56.665613 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d1feb3c-5688-4b7d-baf7-2e5cfb031159 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:56.667773 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d1feb3c-5688-4b7d-baf7-2e5cfb031159 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:56.671404 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2d1feb3c-5688-4b7d-baf7-2e5cfb031159 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.287511 Jul 28 06:39:56.671636 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 202/394] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:56 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:56.682038 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-819edb3f-1992-4c76-863d-845d6f414d2d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:56.682655 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-819edb3f-1992-4c76-863d-845d6f414d2d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:56.689687 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-819edb3f-1992-4c76-863d-845d6f414d2d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:56.690704 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-819edb3f-1992-4c76-863d-845d6f414d2d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:56.691490 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-819edb3f-1992-4c76-863d-845d6f414d2d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:56.691926 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-819edb3f-1992-4c76-863d-845d6f414d2d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:56.795656 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-819edb3f-1992-4c76-863d-845d6f414d2d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:56.804007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ff04819b-53b7-4069-b037-c2e53838873d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:56.805586 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-819edb3f-1992-4c76-863d-845d6f414d2d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.132509 Jul 28 06:39:56.821183 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ff04819b-53b7-4069-b037-c2e53838873d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.268453 Jul 28 06:39:56.821841 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 203/395] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:56 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:56.837504 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 193/396] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:56 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:56.837728 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-67332565-7c4d-4e3b-9848-e56523ab8f53 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:56.837728 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-67332565-7c4d-4e3b-9848-e56523ab8f53 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:56.844384 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67332565-7c4d-4e3b-9848-e56523ab8f53 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:56.844864 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67332565-7c4d-4e3b-9848-e56523ab8f53 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:56.845886 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67332565-7c4d-4e3b-9848-e56523ab8f53 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:56.846646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67332565-7c4d-4e3b-9848-e56523ab8f53 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:56.971361 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a75efa79-a79f-4a8f-80f0-cb1095d33b5a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:56.972613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a75efa79-a79f-4a8f-80f0-cb1095d33b5a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:56.984256 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a75efa79-a79f-4a8f-80f0-cb1095d33b5a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:56.985106 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a75efa79-a79f-4a8f-80f0-cb1095d33b5a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:56.986037 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a75efa79-a79f-4a8f-80f0-cb1095d33b5a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:56.986929 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a75efa79-a79f-4a8f-80f0-cb1095d33b5a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.024903 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a75efa79-a79f-4a8f-80f0-cb1095d33b5a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:39:57.041877 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:57.068101 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-67332565-7c4d-4e3b-9848-e56523ab8f53 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:57.088587 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-67332565-7c4d-4e3b-9848-e56523ab8f53 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.265502 Jul 28 06:39:57.089178 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 204/397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:56 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:57.127032 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-59447ba2-264d-4297-b5fa-cb934d132c72 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:57.128772 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-59447ba2-264d-4297-b5fa-cb934d132c72 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:57.130875 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:57.134825 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a75efa79-a79f-4a8f-80f0-cb1095d33b5a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "DELETE /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 204 len: 0 microversion: 2.1 time: 0.167123 Jul 28 06:39:57.135406 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 194/398] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:39:56 2022] DELETE /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 06:39:57.139652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59447ba2-264d-4297-b5fa-cb934d132c72 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:57.140110 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59447ba2-264d-4297-b5fa-cb934d132c72 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.140888 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59447ba2-264d-4297-b5fa-cb934d132c72 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:57.141398 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59447ba2-264d-4297-b5fa-cb934d132c72 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.145990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0191e6c7-02e8-47f8-9463-a52d8d6b27f9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:57.148429 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0191e6c7-02e8-47f8-9463-a52d8d6b27f9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:57.156417 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0191e6c7-02e8-47f8-9463-a52d8d6b27f9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:57.156963 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0191e6c7-02e8-47f8-9463-a52d8d6b27f9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.157825 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0191e6c7-02e8-47f8-9463-a52d8d6b27f9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:57.158356 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0191e6c7-02e8-47f8-9463-a52d8d6b27f9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.291652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-59447ba2-264d-4297-b5fa-cb934d132c72 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:57.305122 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-59447ba2-264d-4297-b5fa-cb934d132c72 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.182202 Jul 28 06:39:57.317492 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 205/399] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:57 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:57.340009 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0191e6c7-02e8-47f8-9463-a52d8d6b27f9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:57.348591 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0191e6c7-02e8-47f8-9463-a52d8d6b27f9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.208896 Jul 28 06:39:57.349151 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 195/400] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:57 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:57.696258 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9ffa6157-d435-41e5-a709-d0b24965f2fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:57.696984 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9ffa6157-d435-41e5-a709-d0b24965f2fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:57.703906 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9ffa6157-d435-41e5-a709-d0b24965f2fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:57.704357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9ffa6157-d435-41e5-a709-d0b24965f2fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.705117 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9ffa6157-d435-41e5-a709-d0b24965f2fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:57.706194 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9ffa6157-d435-41e5-a709-d0b24965f2fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.831820 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ce0d271d-f4a1-47dc-923c-f893cb11d829 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:57.832528 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ce0d271d-f4a1-47dc-923c-f893cb11d829 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:57.851880 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ce0d271d-f4a1-47dc-923c-f893cb11d829 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:57.852214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ce0d271d-f4a1-47dc-923c-f893cb11d829 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.852988 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ce0d271d-f4a1-47dc-923c-f893cb11d829 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:57.853446 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ce0d271d-f4a1-47dc-923c-f893cb11d829 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.895055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9ffa6157-d435-41e5-a709-d0b24965f2fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:57.914730 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9ffa6157-d435-41e5-a709-d0b24965f2fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:57.916794 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9ffa6157-d435-41e5-a709-d0b24965f2fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:57.920689 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9ffa6157-d435-41e5-a709-d0b24965f2fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.228502 Jul 28 06:39:57.921581 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 206/401] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:57 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:57.929831 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-abff39f0-dbe5-40e2-8695-4e299a9e624f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:57.932525 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-abff39f0-dbe5-40e2-8695-4e299a9e624f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:57.941138 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ce0d271d-f4a1-47dc-923c-f893cb11d829 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:57.949418 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-abff39f0-dbe5-40e2-8695-4e299a9e624f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:57.949687 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ce0d271d-f4a1-47dc-923c-f893cb11d829 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.121562 Jul 28 06:39:57.951023 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-abff39f0-dbe5-40e2-8695-4e299a9e624f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.952046 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-abff39f0-dbe5-40e2-8695-4e299a9e624f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:57.952652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-abff39f0-dbe5-40e2-8695-4e299a9e624f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:57.963164 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 196/402] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:57 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:58.112311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-870befb1-42db-44b5-b7b9-c4b0d65791cc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:58.112819 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-870befb1-42db-44b5-b7b9-c4b0d65791cc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:58.122146 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-870befb1-42db-44b5-b7b9-c4b0d65791cc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.122751 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-870befb1-42db-44b5-b7b9-c4b0d65791cc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:58.123886 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-870befb1-42db-44b5-b7b9-c4b0d65791cc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.124655 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-870befb1-42db-44b5-b7b9-c4b0d65791cc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:58.138166 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-abff39f0-dbe5-40e2-8695-4e299a9e624f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:58.146955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-abff39f0-dbe5-40e2-8695-4e299a9e624f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.224367 Jul 28 06:39:58.147860 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 207/403] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:57 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:58.292686 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-f2106fa1-2560-49b1-9324-4b6cad577ea9 req-80d6bf8e-0c60-4a6c-b553-ded689ed8d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019e1e9c-7545-477a-bae9-47c555ae07e2", "name": "network-vif-plugged", "status": "completed", "tag": "626917cf-1bf9-47dd-b3eb-784f6c8fdad0"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:58.292873 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-870befb1-42db-44b5-b7b9-c4b0d65791cc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:58.312309 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-870befb1-42db-44b5-b7b9-c4b0d65791cc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.204906 Jul 28 06:39:58.313048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 197/404] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:58 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:58.316707 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-f2106fa1-2560-49b1-9324-4b6cad577ea9 req-80d6bf8e-0c60-4a6c-b553-ded689ed8d92 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.317161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-f2106fa1-2560-49b1-9324-4b6cad577ea9 req-80d6bf8e-0c60-4a6c-b553-ded689ed8d92 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:58.323987 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:58.332918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d112a255-801f-43b3-95d4-3b190982252d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:58.333812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d112a255-801f-43b3-95d4-3b190982252d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:58.340110 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-f2106fa1-2560-49b1-9324-4b6cad577ea9 req-80d6bf8e-0c60-4a6c-b553-ded689ed8d92 service nova] Creating event network-vif-plugged:626917cf-1bf9-47dd-b3eb-784f6c8fdad0 for instance 019e1e9c-7545-477a-bae9-47c555ae07e2 on hv-cinder-85060 Jul 28 06:39:58.340693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d112a255-801f-43b3-95d4-3b190982252d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.341166 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d112a255-801f-43b3-95d4-3b190982252d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:58.342310 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d112a255-801f-43b3-95d4-3b190982252d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.342745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d112a255-801f-43b3-95d4-3b190982252d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:58.350697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-f2106fa1-2560-49b1-9324-4b6cad577ea9 req-80d6bf8e-0c60-4a6c-b553-ded689ed8d92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063429 Jul 28 06:39:58.351332 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 208/405] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:39:58.371743 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c82f5d15-bec5-4803-b926-80fbdb42a3e4 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:58.372467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c82f5d15-bec5-4803-b926-80fbdb42a3e4 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:58.385944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c82f5d15-bec5-4803-b926-80fbdb42a3e4 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.393798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c82f5d15-bec5-4803-b926-80fbdb42a3e4 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:58.394798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c82f5d15-bec5-4803-b926-80fbdb42a3e4 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.395389 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c82f5d15-bec5-4803-b926-80fbdb42a3e4 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:58.524970 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d112a255-801f-43b3-95d4-3b190982252d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:58.535133 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d112a255-801f-43b3-95d4-3b190982252d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.206626 Jul 28 06:39:58.537968 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 198/406] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:58 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:58.619527 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c82f5d15-bec5-4803-b926-80fbdb42a3e4 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:58.628722 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c82f5d15-bec5-4803-b926-80fbdb42a3e4 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.263149 Jul 28 06:39:58.631558 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 209/407] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:58 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:58.946620 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-15343d52-3852-4e0f-b959-1acb3b68dbd3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:58.947289 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-15343d52-3852-4e0f-b959-1acb3b68dbd3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:58.956524 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15343d52-3852-4e0f-b959-1acb3b68dbd3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.956973 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15343d52-3852-4e0f-b959-1acb3b68dbd3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:58.957988 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15343d52-3852-4e0f-b959-1acb3b68dbd3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.958432 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15343d52-3852-4e0f-b959-1acb3b68dbd3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:58.970197 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-379e6d1c-5657-4889-bee6-ef727e0f1032 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:58.977118 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-379e6d1c-5657-4889-bee6-ef727e0f1032 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:58.984281 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-379e6d1c-5657-4889-bee6-ef727e0f1032 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.984805 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-379e6d1c-5657-4889-bee6-ef727e0f1032 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:58.985732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-379e6d1c-5657-4889-bee6-ef727e0f1032 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:58.986290 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-379e6d1c-5657-4889-bee6-ef727e0f1032 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:59.071729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-379e6d1c-5657-4889-bee6-ef727e0f1032 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:59.086096 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-379e6d1c-5657-4889-bee6-ef727e0f1032 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.116597 Jul 28 06:39:59.097750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 210/408] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:58 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:59.122418 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-15343d52-3852-4e0f-b959-1acb3b68dbd3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:59.131065 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-15343d52-3852-4e0f-b959-1acb3b68dbd3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:59.132581 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-15343d52-3852-4e0f-b959-1acb3b68dbd3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:59.133781 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-15343d52-3852-4e0f-b959-1acb3b68dbd3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.191819 Jul 28 06:39:59.134373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 199/409] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:39:58 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:39:59.168465 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0acc7ddd-c7c0-4d1e-bba2-c8765702476f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:59.169066 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0acc7ddd-c7c0-4d1e-bba2-c8765702476f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:59.175647 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0acc7ddd-c7c0-4d1e-bba2-c8765702476f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:59.176096 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0acc7ddd-c7c0-4d1e-bba2-c8765702476f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:59.176876 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0acc7ddd-c7c0-4d1e-bba2-c8765702476f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:59.177332 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0acc7ddd-c7c0-4d1e-bba2-c8765702476f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:59.319452 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0acc7ddd-c7c0-4d1e-bba2-c8765702476f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:59.327116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0acc7ddd-c7c0-4d1e-bba2-c8765702476f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.162468 Jul 28 06:39:59.327680 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 211/410] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:59 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:59.335618 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e4bdf07f-eb1e-4f7e-bd01-3ccc01950c47 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:59.336419 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e4bdf07f-eb1e-4f7e-bd01-3ccc01950c47 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:59.343377 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e4bdf07f-eb1e-4f7e-bd01-3ccc01950c47 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:59.343826 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e4bdf07f-eb1e-4f7e-bd01-3ccc01950c47 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:59.344661 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e4bdf07f-eb1e-4f7e-bd01-3ccc01950c47 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:59.345097 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e4bdf07f-eb1e-4f7e-bd01-3ccc01950c47 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:59.535865 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e4bdf07f-eb1e-4f7e-bd01-3ccc01950c47 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:59.543213 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e4bdf07f-eb1e-4f7e-bd01-3ccc01950c47 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.212445 Jul 28 06:39:59.544393 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 200/411] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:59 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:59.573226 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-fa5473d4-6c2c-4c67-b3ed-76cc95cf0a98 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:59.573875 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-fa5473d4-6c2c-4c67-b3ed-76cc95cf0a98 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:59.580847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa5473d4-6c2c-4c67-b3ed-76cc95cf0a98 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:59.582287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa5473d4-6c2c-4c67-b3ed-76cc95cf0a98 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:59.583072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa5473d4-6c2c-4c67-b3ed-76cc95cf0a98 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:59.583517 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa5473d4-6c2c-4c67-b3ed-76cc95cf0a98 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:59.649319 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6ac27575-899c-411a-b14c-304a01f0a27f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:59.649965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6ac27575-899c-411a-b14c-304a01f0a27f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:59.656599 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6ac27575-899c-411a-b14c-304a01f0a27f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:59.657283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6ac27575-899c-411a-b14c-304a01f0a27f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:59.658077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6ac27575-899c-411a-b14c-304a01f0a27f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:59.659529 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6ac27575-899c-411a-b14c-304a01f0a27f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:59.770574 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-fa5473d4-6c2c-4c67-b3ed-76cc95cf0a98 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:59.785714 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-fa5473d4-6c2c-4c67-b3ed-76cc95cf0a98 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.217087 Jul 28 06:39:59.797333 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 212/412] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:59 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:59.842857 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6ac27575-899c-411a-b14c-304a01f0a27f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:59.851801 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6ac27575-899c-411a-b14c-304a01f0a27f tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.206241 Jul 28 06:39:59.852369 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 201/413] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:59 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:00.108496 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0b8fd410-e23e-4685-b0a0-b01166128bca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:00.109103 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0b8fd410-e23e-4685-b0a0-b01166128bca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:00.116156 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b8fd410-e23e-4685-b0a0-b01166128bca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.117209 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b8fd410-e23e-4685-b0a0-b01166128bca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.118007 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b8fd410-e23e-4685-b0a0-b01166128bca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.118645 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b8fd410-e23e-4685-b0a0-b01166128bca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.159265 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-245150cb-7d25-4160-8cee-aecc751c59f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:00.160560 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-245150cb-7d25-4160-8cee-aecc751c59f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:00.168737 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-245150cb-7d25-4160-8cee-aecc751c59f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.170399 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-245150cb-7d25-4160-8cee-aecc751c59f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.171350 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-245150cb-7d25-4160-8cee-aecc751c59f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.171933 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-245150cb-7d25-4160-8cee-aecc751c59f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.201944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0b8fd410-e23e-4685-b0a0-b01166128bca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:00.215738 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0b8fd410-e23e-4685-b0a0-b01166128bca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.109789 Jul 28 06:40:00.227370 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 213/414] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:00 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:00.344236 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-245150cb-7d25-4160-8cee-aecc751c59f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:00.353985 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-245150cb-7d25-4160-8cee-aecc751c59f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:00.355491 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-245150cb-7d25-4160-8cee-aecc751c59f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:00.356719 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-245150cb-7d25-4160-8cee-aecc751c59f7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.201820 Jul 28 06:40:00.357485 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 202/415] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:00 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:00.362252 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-cdc98de1-1058-4618-86ab-56aaf9676a6c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:00.363008 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-cdc98de1-1058-4618-86ab-56aaf9676a6c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:00.369314 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cdc98de1-1058-4618-86ab-56aaf9676a6c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.369849 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cdc98de1-1058-4618-86ab-56aaf9676a6c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.370762 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cdc98de1-1058-4618-86ab-56aaf9676a6c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.371272 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cdc98de1-1058-4618-86ab-56aaf9676a6c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.374863 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-2874f3f6-6bf8-4ceb-9acd-36b814ce673d req-b6a518ee-2a56-4c7c-b192-a0efb02c7839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a882b29e-1e41-4e8d-a8ed-7cdd735d175e", "name": "network-vif-plugged", "status": "completed", "tag": "f779dd90-25ac-4b48-b542-655c148fc093"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:00.387895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-2874f3f6-6bf8-4ceb-9acd-36b814ce673d req-b6a518ee-2a56-4c7c-b192-a0efb02c7839 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.388334 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-2874f3f6-6bf8-4ceb-9acd-36b814ce673d req-b6a518ee-2a56-4c7c-b192-a0efb02c7839 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.406131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-2874f3f6-6bf8-4ceb-9acd-36b814ce673d req-b6a518ee-2a56-4c7c-b192-a0efb02c7839 service nova] Creating event network-vif-plugged:f779dd90-25ac-4b48-b542-655c148fc093 for instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e on hv-cinder-85060 Jul 28 06:40:00.415329 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-2874f3f6-6bf8-4ceb-9acd-36b814ce673d req-b6a518ee-2a56-4c7c-b192-a0efb02c7839 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047465 Jul 28 06:40:00.416036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 203/416] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:40:00.543795 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-cdc98de1-1058-4618-86ab-56aaf9676a6c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:00.551583 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-cdc98de1-1058-4618-86ab-56aaf9676a6c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.193714 Jul 28 06:40:00.552145 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 214/417] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:00 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:00.564531 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-204d7238-bb19-486e-a99b-646e85627051 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:00.565737 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-204d7238-bb19-486e-a99b-646e85627051 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:00.572668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-204d7238-bb19-486e-a99b-646e85627051 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.573120 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-204d7238-bb19-486e-a99b-646e85627051 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.573943 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-204d7238-bb19-486e-a99b-646e85627051 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.574380 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-204d7238-bb19-486e-a99b-646e85627051 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.744541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-204d7238-bb19-486e-a99b-646e85627051 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:00.756536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-204d7238-bb19-486e-a99b-646e85627051 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.196125 Jul 28 06:40:00.757324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 204/418] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:00 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:00.809672 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7f0c11c7-1019-4f73-81d0-0c5655e39a2f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:00.811109 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7f0c11c7-1019-4f73-81d0-0c5655e39a2f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:00.818149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7f0c11c7-1019-4f73-81d0-0c5655e39a2f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.818885 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7f0c11c7-1019-4f73-81d0-0c5655e39a2f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.819864 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7f0c11c7-1019-4f73-81d0-0c5655e39a2f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.820428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7f0c11c7-1019-4f73-81d0-0c5655e39a2f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.873655 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f259247f-1f67-4975-b29a-8aadb86f5ace tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:00.874266 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f259247f-1f67-4975-b29a-8aadb86f5ace tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:00.881750 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f259247f-1f67-4975-b29a-8aadb86f5ace tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.882201 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f259247f-1f67-4975-b29a-8aadb86f5ace tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.883001 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f259247f-1f67-4975-b29a-8aadb86f5ace tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:00.883436 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f259247f-1f67-4975-b29a-8aadb86f5ace tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:00.990715 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7f0c11c7-1019-4f73-81d0-0c5655e39a2f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:00.998349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7f0c11c7-1019-4f73-81d0-0c5655e39a2f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.193962 Jul 28 06:40:00.998917 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 215/419] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:00 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:01.039237 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f259247f-1f67-4975-b29a-8aadb86f5ace tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:01.046958 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f259247f-1f67-4975-b29a-8aadb86f5ace tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.177258 Jul 28 06:40:01.047532 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 205/420] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:00 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:01.239430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5fffee53-ea7d-44ff-9678-60c1a182a3c0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:01.240347 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5fffee53-ea7d-44ff-9678-60c1a182a3c0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:01.247469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5fffee53-ea7d-44ff-9678-60c1a182a3c0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:01.248020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5fffee53-ea7d-44ff-9678-60c1a182a3c0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:01.248978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5fffee53-ea7d-44ff-9678-60c1a182a3c0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:01.249541 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5fffee53-ea7d-44ff-9678-60c1a182a3c0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:01.321711 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5fffee53-ea7d-44ff-9678-60c1a182a3c0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:01.329108 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5fffee53-ea7d-44ff-9678-60c1a182a3c0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.094810 Jul 28 06:40:01.329957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 216/421] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:01 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:01.382706 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-384d1f5d-5b7e-4b52-88dd-8cbf84be6722 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:01.383319 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-384d1f5d-5b7e-4b52-88dd-8cbf84be6722 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:01.389475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-384d1f5d-5b7e-4b52-88dd-8cbf84be6722 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:01.389926 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-384d1f5d-5b7e-4b52-88dd-8cbf84be6722 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:01.390694 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-384d1f5d-5b7e-4b52-88dd-8cbf84be6722 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:01.391132 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-384d1f5d-5b7e-4b52-88dd-8cbf84be6722 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:01.541873 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-384d1f5d-5b7e-4b52-88dd-8cbf84be6722 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:01.550626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-384d1f5d-5b7e-4b52-88dd-8cbf84be6722 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:01.552143 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-384d1f5d-5b7e-4b52-88dd-8cbf84be6722 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:01.553318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-384d1f5d-5b7e-4b52-88dd-8cbf84be6722 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.174592 Jul 28 06:40:01.553887 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 206/422] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:01 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:01.573988 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ee292fb4-2dad-4d90-a537-1637713c5c8d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:01.574710 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ee292fb4-2dad-4d90-a537-1637713c5c8d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:01.584181 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ee292fb4-2dad-4d90-a537-1637713c5c8d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:01.584734 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ee292fb4-2dad-4d90-a537-1637713c5c8d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:01.585731 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ee292fb4-2dad-4d90-a537-1637713c5c8d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:01.586171 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ee292fb4-2dad-4d90-a537-1637713c5c8d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:01.764090 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ee292fb4-2dad-4d90-a537-1637713c5c8d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:01.775523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ee292fb4-2dad-4d90-a537-1637713c5c8d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.205512 Jul 28 06:40:01.776105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 217/423] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:01 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:01.776924 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5d9bd45f-17c8-4e8a-8584-a8f80e5344fc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:01.777617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5d9bd45f-17c8-4e8a-8584-a8f80e5344fc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:01.789281 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d9bd45f-17c8-4e8a-8584-a8f80e5344fc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:01.795925 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d9bd45f-17c8-4e8a-8584-a8f80e5344fc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:01.796876 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d9bd45f-17c8-4e8a-8584-a8f80e5344fc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:01.797356 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5d9bd45f-17c8-4e8a-8584-a8f80e5344fc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:01.966710 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5d9bd45f-17c8-4e8a-8584-a8f80e5344fc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:01.975357 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5d9bd45f-17c8-4e8a-8584-a8f80e5344fc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.202404 Jul 28 06:40:01.975945 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 207/424] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:01 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:02.019563 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8a2d5305-67f5-46e1-8a38-f559f26b56f6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:02.020168 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8a2d5305-67f5-46e1-8a38-f559f26b56f6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:02.026280 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a2d5305-67f5-46e1-8a38-f559f26b56f6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:02.026737 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a2d5305-67f5-46e1-8a38-f559f26b56f6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:02.027513 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a2d5305-67f5-46e1-8a38-f559f26b56f6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:02.027955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a2d5305-67f5-46e1-8a38-f559f26b56f6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:02.068045 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-37ee6c0d-242c-4e40-9453-5ccdeadb2b75 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:02.068965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-37ee6c0d-242c-4e40-9453-5ccdeadb2b75 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:02.075155 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-37ee6c0d-242c-4e40-9453-5ccdeadb2b75 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:02.075597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-37ee6c0d-242c-4e40-9453-5ccdeadb2b75 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:02.076368 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-37ee6c0d-242c-4e40-9453-5ccdeadb2b75 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:02.076795 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-37ee6c0d-242c-4e40-9453-5ccdeadb2b75 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:02.183018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8a2d5305-67f5-46e1-8a38-f559f26b56f6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:02.204039 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8a2d5305-67f5-46e1-8a38-f559f26b56f6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.188200 Jul 28 06:40:02.204635 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 218/425] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:02 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:02.232991 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-37ee6c0d-242c-4e40-9453-5ccdeadb2b75 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:02.240861 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-37ee6c0d-242c-4e40-9453-5ccdeadb2b75 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.176855 Jul 28 06:40:02.241440 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 208/426] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:02 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:02.352949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3b7783c1-ebe3-43aa-ba4a-c52d109f9d1d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:02.353576 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3b7783c1-ebe3-43aa-ba4a-c52d109f9d1d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:02.360018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3b7783c1-ebe3-43aa-ba4a-c52d109f9d1d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:02.360476 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3b7783c1-ebe3-43aa-ba4a-c52d109f9d1d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:02.361237 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3b7783c1-ebe3-43aa-ba4a-c52d109f9d1d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:02.361783 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3b7783c1-ebe3-43aa-ba4a-c52d109f9d1d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:02.427769 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3b7783c1-ebe3-43aa-ba4a-c52d109f9d1d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:02.435769 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3b7783c1-ebe3-43aa-ba4a-c52d109f9d1d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.086822 Jul 28 06:40:02.436338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 219/427] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:02 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:02.583398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9f242767-a15a-441c-a33b-495c2c2b63d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:02.583996 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9f242767-a15a-441c-a33b-495c2c2b63d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:02.590247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f242767-a15a-441c-a33b-495c2c2b63d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:02.590706 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f242767-a15a-441c-a33b-495c2c2b63d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:02.591471 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f242767-a15a-441c-a33b-495c2c2b63d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:02.591913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f242767-a15a-441c-a33b-495c2c2b63d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:02.739182 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9f242767-a15a-441c-a33b-495c2c2b63d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:02.747665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9f242767-a15a-441c-a33b-495c2c2b63d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:02.749363 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9f242767-a15a-441c-a33b-495c2c2b63d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:02.750533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9f242767-a15a-441c-a33b-495c2c2b63d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.171059 Jul 28 06:40:02.751094 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 209/428] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:02 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:02.798913 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-64f9324b-32bd-41c0-b577-fe59f3343b0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:02.800295 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-64f9324b-32bd-41c0-b577-fe59f3343b0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:02.815557 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-64f9324b-32bd-41c0-b577-fe59f3343b0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:02.816016 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-64f9324b-32bd-41c0-b577-fe59f3343b0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:02.816804 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-64f9324b-32bd-41c0-b577-fe59f3343b0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:02.817258 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-64f9324b-32bd-41c0-b577-fe59f3343b0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:02.963140 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-64f9324b-32bd-41c0-b577-fe59f3343b0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:02.981795 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-64f9324b-32bd-41c0-b577-fe59f3343b0a tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.182462 Jul 28 06:40:02.982729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 220/429] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:02 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:03.004584 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b537df44-04b3-403a-b98d-30ca7d8a1a62 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:03.005229 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b537df44-04b3-403a-b98d-30ca7d8a1a62 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:03.011521 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b537df44-04b3-403a-b98d-30ca7d8a1a62 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:03.011971 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b537df44-04b3-403a-b98d-30ca7d8a1a62 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:03.012745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b537df44-04b3-403a-b98d-30ca7d8a1a62 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:03.013233 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b537df44-04b3-403a-b98d-30ca7d8a1a62 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:03.155917 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b537df44-04b3-403a-b98d-30ca7d8a1a62 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:03.158518 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:03.167140 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b537df44-04b3-403a-b98d-30ca7d8a1a62 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.169477 Jul 28 06:40:03.177998 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 210/430] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:02 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:03.225977 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1840df36-192d-448d-81fb-d059970c3dfe tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:03.226585 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1840df36-192d-448d-81fb-d059970c3dfe tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:03.232807 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1840df36-192d-448d-81fb-d059970c3dfe tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:03.233260 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1840df36-192d-448d-81fb-d059970c3dfe tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:03.234074 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1840df36-192d-448d-81fb-d059970c3dfe tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:03.234511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1840df36-192d-448d-81fb-d059970c3dfe tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:03.265001 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-400a2a72-7b32-4416-8a7a-10a5ffeb04ec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:03.266035 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-400a2a72-7b32-4416-8a7a-10a5ffeb04ec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:03.274108 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-400a2a72-7b32-4416-8a7a-10a5ffeb04ec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:03.275118 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-400a2a72-7b32-4416-8a7a-10a5ffeb04ec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:03.278022 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-400a2a72-7b32-4416-8a7a-10a5ffeb04ec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:03.278799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-400a2a72-7b32-4416-8a7a-10a5ffeb04ec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:03.397505 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1840df36-192d-448d-81fb-d059970c3dfe tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:03.406383 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1840df36-192d-448d-81fb-d059970c3dfe tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.183999 Jul 28 06:40:03.407168 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 221/431] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:03 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:03.445404 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-400a2a72-7b32-4416-8a7a-10a5ffeb04ec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:03.455215 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-400a2a72-7b32-4416-8a7a-10a5ffeb04ec tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.194690 Jul 28 06:40:03.456050 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 211/432] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:03 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:03.457279 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b620bbcb-589d-45f9-8463-75f93d1f5b74 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:03.458027 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b620bbcb-589d-45f9-8463-75f93d1f5b74 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:03.465162 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b620bbcb-589d-45f9-8463-75f93d1f5b74 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:03.466223 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b620bbcb-589d-45f9-8463-75f93d1f5b74 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:03.467198 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b620bbcb-589d-45f9-8463-75f93d1f5b74 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:03.467834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b620bbcb-589d-45f9-8463-75f93d1f5b74 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:03.532480 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b620bbcb-589d-45f9-8463-75f93d1f5b74 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:03.541656 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b620bbcb-589d-45f9-8463-75f93d1f5b74 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.089201 Jul 28 06:40:03.542428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 222/433] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:03 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:03.774927 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d2dba526-d919-48cb-8ebe-7b1986b56923 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:03.775535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d2dba526-d919-48cb-8ebe-7b1986b56923 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:03.781600 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d2dba526-d919-48cb-8ebe-7b1986b56923 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:03.782053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d2dba526-d919-48cb-8ebe-7b1986b56923 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:03.782816 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d2dba526-d919-48cb-8ebe-7b1986b56923 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:03.783822 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d2dba526-d919-48cb-8ebe-7b1986b56923 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:03.940344 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d2dba526-d919-48cb-8ebe-7b1986b56923 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:03.948688 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d2dba526-d919-48cb-8ebe-7b1986b56923 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:03.950225 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d2dba526-d919-48cb-8ebe-7b1986b56923 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:03.951382 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d2dba526-d919-48cb-8ebe-7b1986b56923 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.180377 Jul 28 06:40:03.951944 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 212/434] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:03 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:04.007146 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-297456d6-5776-4a43-a2c5-a77a5f103852 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:04.007757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-297456d6-5776-4a43-a2c5-a77a5f103852 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:04.013790 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-297456d6-5776-4a43-a2c5-a77a5f103852 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.014248 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-297456d6-5776-4a43-a2c5-a77a5f103852 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.015036 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-297456d6-5776-4a43-a2c5-a77a5f103852 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.015477 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-297456d6-5776-4a43-a2c5-a77a5f103852 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.154564 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-297456d6-5776-4a43-a2c5-a77a5f103852 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:04.165684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-297456d6-5776-4a43-a2c5-a77a5f103852 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.162264 Jul 28 06:40:04.166566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 223/435] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:04 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:04.190580 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-91ae4db1-1dc0-4998-ab49-8403e2e81b88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:04.191213 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-91ae4db1-1dc0-4998-ab49-8403e2e81b88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:04.197765 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91ae4db1-1dc0-4998-ab49-8403e2e81b88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.198211 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91ae4db1-1dc0-4998-ab49-8403e2e81b88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.199069 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91ae4db1-1dc0-4998-ab49-8403e2e81b88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.199496 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91ae4db1-1dc0-4998-ab49-8403e2e81b88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.338157 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-91ae4db1-1dc0-4998-ab49-8403e2e81b88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:04.345657 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-91ae4db1-1dc0-4998-ab49-8403e2e81b88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.160005 Jul 28 06:40:04.346208 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 213/436] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:04 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:04.428755 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1831112d-fdb1-47d0-b518-14f215577fc0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:04.429419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1831112d-fdb1-47d0-b518-14f215577fc0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:04.436134 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1831112d-fdb1-47d0-b518-14f215577fc0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.436582 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1831112d-fdb1-47d0-b518-14f215577fc0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.437472 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1831112d-fdb1-47d0-b518-14f215577fc0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.438007 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1831112d-fdb1-47d0-b518-14f215577fc0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.476677 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a57b3121-bdc8-4743-a5e5-399768f81398 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:04.477744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a57b3121-bdc8-4743-a5e5-399768f81398 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:04.488236 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a57b3121-bdc8-4743-a5e5-399768f81398 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.488792 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a57b3121-bdc8-4743-a5e5-399768f81398 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.489740 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a57b3121-bdc8-4743-a5e5-399768f81398 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.490256 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a57b3121-bdc8-4743-a5e5-399768f81398 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.588759 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1831112d-fdb1-47d0-b518-14f215577fc0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:04.597632 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1831112d-fdb1-47d0-b518-14f215577fc0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.173240 Jul 28 06:40:04.598376 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 224/437] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:04 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:04.602682 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5a39d8d0-313d-4339-b81e-69f81966e0e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:04.603310 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5a39d8d0-313d-4339-b81e-69f81966e0e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:04.610204 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a39d8d0-313d-4339-b81e-69f81966e0e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.610725 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a39d8d0-313d-4339-b81e-69f81966e0e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.613185 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a39d8d0-313d-4339-b81e-69f81966e0e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.613737 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a39d8d0-313d-4339-b81e-69f81966e0e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.632617 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:04.685599 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5a39d8d0-313d-4339-b81e-69f81966e0e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:04.699122 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5a39d8d0-313d-4339-b81e-69f81966e0e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.099737 Jul 28 06:40:04.700045 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 225/438] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:04 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:04.707499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a57b3121-bdc8-4743-a5e5-399768f81398 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:04.715195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a57b3121-bdc8-4743-a5e5-399768f81398 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.242358 Jul 28 06:40:04.715762 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 214/439] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:04 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:04.980609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9bfcea1e-f18a-45ba-be87-161b30dfaba6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:04.981285 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9bfcea1e-f18a-45ba-be87-161b30dfaba6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:04.990684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9bfcea1e-f18a-45ba-be87-161b30dfaba6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.991150 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9bfcea1e-f18a-45ba-be87-161b30dfaba6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:04.991939 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9bfcea1e-f18a-45ba-be87-161b30dfaba6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:04.992377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9bfcea1e-f18a-45ba-be87-161b30dfaba6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.130565 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9bfcea1e-f18a-45ba-be87-161b30dfaba6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:05.138377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9bfcea1e-f18a-45ba-be87-161b30dfaba6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:05.139880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9bfcea1e-f18a-45ba-be87-161b30dfaba6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:05.141010 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9bfcea1e-f18a-45ba-be87-161b30dfaba6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.165175 Jul 28 06:40:05.141585 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 226/440] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:04 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:05.187878 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bdb72f34-f5d6-4e61-8198-da0f9de6ead2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:05.188448 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bdb72f34-f5d6-4e61-8198-da0f9de6ead2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:05.197444 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bdb72f34-f5d6-4e61-8198-da0f9de6ead2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:05.198103 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bdb72f34-f5d6-4e61-8198-da0f9de6ead2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.199905 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bdb72f34-f5d6-4e61-8198-da0f9de6ead2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:05.201043 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bdb72f34-f5d6-4e61-8198-da0f9de6ead2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.346598 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bdb72f34-f5d6-4e61-8198-da0f9de6ead2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:05.354368 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bdb72f34-f5d6-4e61-8198-da0f9de6ead2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.170500 Jul 28 06:40:05.354947 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 215/441] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:05 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:05.366716 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4d1b81ff-27f7-4646-acee-0182137cc806 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:05.367355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4d1b81ff-27f7-4646-acee-0182137cc806 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:05.373800 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4d1b81ff-27f7-4646-acee-0182137cc806 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:05.374246 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4d1b81ff-27f7-4646-acee-0182137cc806 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.375021 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4d1b81ff-27f7-4646-acee-0182137cc806 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:05.375458 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4d1b81ff-27f7-4646-acee-0182137cc806 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.517098 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4d1b81ff-27f7-4646-acee-0182137cc806 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:05.526559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4d1b81ff-27f7-4646-acee-0182137cc806 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.163816 Jul 28 06:40:05.527148 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 227/442] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:05 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:05.620814 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bd652d75-161c-4f7d-a59b-760c25426fc5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:05.622037 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bd652d75-161c-4f7d-a59b-760c25426fc5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:05.629804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:05.630777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=16 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:05.633748 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bd652d75-161c-4f7d-a59b-760c25426fc5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:05.634312 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bd652d75-161c-4f7d-a59b-760c25426fc5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.635309 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bd652d75-161c-4f7d-a59b-760c25426fc5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:05.635756 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bd652d75-161c-4f7d-a59b-760c25426fc5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.724299 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e377cb1d-dead-445a-a5e4-e09b9de7b158 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:05.725138 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e377cb1d-dead-445a-a5e4-e09b9de7b158 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:05.727536 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:05.746649 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e377cb1d-dead-445a-a5e4-e09b9de7b158 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:05.746902 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e377cb1d-dead-445a-a5e4-e09b9de7b158 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.748630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e377cb1d-dead-445a-a5e4-e09b9de7b158 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:05.749129 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e377cb1d-dead-445a-a5e4-e09b9de7b158 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.862856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bd652d75-161c-4f7d-a59b-760c25426fc5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:05.871040 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bd652d75-161c-4f7d-a59b-760c25426fc5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.254841 Jul 28 06:40:05.872973 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 216/443] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:05 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:05.876588 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-051623b3-e784-46bd-a585-09f4a4f2e956 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:05.877946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-051623b3-e784-46bd-a585-09f4a4f2e956 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:05.883983 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-051623b3-e784-46bd-a585-09f4a4f2e956 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:05.884432 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-051623b3-e784-46bd-a585-09f4a4f2e956 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.885034 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e377cb1d-dead-445a-a5e4-e09b9de7b158 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:05.885191 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-051623b3-e784-46bd-a585-09f4a4f2e956 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:05.885658 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-051623b3-e784-46bd-a585-09f4a4f2e956 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:05.892493 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e377cb1d-dead-445a-a5e4-e09b9de7b158 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.173311 Jul 28 06:40:05.893940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 228/444] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:05 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:06.039050 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-051623b3-e784-46bd-a585-09f4a4f2e956 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:06.047394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-051623b3-e784-46bd-a585-09f4a4f2e956 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.174282 Jul 28 06:40:06.047975 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 217/445] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:05 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:06.165381 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-75370a20-f5b2-4a52-90b9-9cc69f186ec3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:06.165901 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-75370a20-f5b2-4a52-90b9-9cc69f186ec3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:06.172153 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-75370a20-f5b2-4a52-90b9-9cc69f186ec3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:06.172602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-75370a20-f5b2-4a52-90b9-9cc69f186ec3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:06.173429 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-75370a20-f5b2-4a52-90b9-9cc69f186ec3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:06.173889 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-75370a20-f5b2-4a52-90b9-9cc69f186ec3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:06.309843 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-75370a20-f5b2-4a52-90b9-9cc69f186ec3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:06.317980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-75370a20-f5b2-4a52-90b9-9cc69f186ec3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:06.319780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-75370a20-f5b2-4a52-90b9-9cc69f186ec3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:06.320933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-75370a20-f5b2-4a52-90b9-9cc69f186ec3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.159849 Jul 28 06:40:06.321513 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 229/446] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:06 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:06.376187 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cac6cd1a-1c48-47db-8360-cc66001a8136 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:06.376800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cac6cd1a-1c48-47db-8360-cc66001a8136 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:06.383681 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cac6cd1a-1c48-47db-8360-cc66001a8136 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:06.384127 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cac6cd1a-1c48-47db-8360-cc66001a8136 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:06.384899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cac6cd1a-1c48-47db-8360-cc66001a8136 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:06.385357 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cac6cd1a-1c48-47db-8360-cc66001a8136 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:06.531271 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cac6cd1a-1c48-47db-8360-cc66001a8136 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:06.539556 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cac6cd1a-1c48-47db-8360-cc66001a8136 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.167259 Jul 28 06:40:06.540124 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 218/447] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:06 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:06.547906 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f9815fb4-49e1-4ad4-a8dd-a00b65ff9b26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:06.548522 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f9815fb4-49e1-4ad4-a8dd-a00b65ff9b26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:06.555359 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f9815fb4-49e1-4ad4-a8dd-a00b65ff9b26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:06.555818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f9815fb4-49e1-4ad4-a8dd-a00b65ff9b26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:06.556583 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f9815fb4-49e1-4ad4-a8dd-a00b65ff9b26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:06.557021 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f9815fb4-49e1-4ad4-a8dd-a00b65ff9b26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:06.693104 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f9815fb4-49e1-4ad4-a8dd-a00b65ff9b26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:06.701141 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f9815fb4-49e1-4ad4-a8dd-a00b65ff9b26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.157001 Jul 28 06:40:06.701878 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 230/448] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:06 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:06.892498 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1ec07966-51c4-486c-965e-16646d37388e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:06.893199 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1ec07966-51c4-486c-965e-16646d37388e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:06.899340 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1ec07966-51c4-486c-965e-16646d37388e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:06.899772 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1ec07966-51c4-486c-965e-16646d37388e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:06.900522 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1ec07966-51c4-486c-965e-16646d37388e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:06.900949 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1ec07966-51c4-486c-965e-16646d37388e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:06.914192 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-855dec77-b3bf-4aae-af80-f545383efc3a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:06.914802 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-855dec77-b3bf-4aae-af80-f545383efc3a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:06.920760 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-855dec77-b3bf-4aae-af80-f545383efc3a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:06.921266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-855dec77-b3bf-4aae-af80-f545383efc3a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:06.922073 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-855dec77-b3bf-4aae-af80-f545383efc3a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:06.922560 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-855dec77-b3bf-4aae-af80-f545383efc3a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:06.994421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-855dec77-b3bf-4aae-af80-f545383efc3a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:07.002935 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-855dec77-b3bf-4aae-af80-f545383efc3a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.091820 Jul 28 06:40:07.003888 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 231/449] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:06 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:07.041162 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1ec07966-51c4-486c-965e-16646d37388e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:07.048613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1ec07966-51c4-486c-965e-16646d37388e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.160177 Jul 28 06:40:07.050067 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 219/450] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:06 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:07.069159 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3dda6f84-3943-40d5-8000-e6e32ed10435 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:07.069834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3dda6f84-3943-40d5-8000-e6e32ed10435 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:07.076968 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dda6f84-3943-40d5-8000-e6e32ed10435 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:07.077514 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dda6f84-3943-40d5-8000-e6e32ed10435 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:07.078281 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dda6f84-3943-40d5-8000-e6e32ed10435 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:07.079111 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dda6f84-3943-40d5-8000-e6e32ed10435 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:07.230605 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3dda6f84-3943-40d5-8000-e6e32ed10435 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:07.239394 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3dda6f84-3943-40d5-8000-e6e32ed10435 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.175256 Jul 28 06:40:07.239978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 232/451] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:07 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:07.344468 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-8b19da4e-bdb8-499e-bab1-49acbca67a83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:07.345423 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-8b19da4e-bdb8-499e-bab1-49acbca67a83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:07.352979 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b19da4e-bdb8-499e-bab1-49acbca67a83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:07.353846 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b19da4e-bdb8-499e-bab1-49acbca67a83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:07.354716 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b19da4e-bdb8-499e-bab1-49acbca67a83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:07.355337 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8b19da4e-bdb8-499e-bab1-49acbca67a83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:07.502921 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8b19da4e-bdb8-499e-bab1-49acbca67a83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:07.511577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8b19da4e-bdb8-499e-bab1-49acbca67a83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:07.513083 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8b19da4e-bdb8-499e-bab1-49acbca67a83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:07.514284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-8b19da4e-bdb8-499e-bab1-49acbca67a83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.174123 Jul 28 06:40:07.515025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 220/452] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:07 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:07.559916 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e037dc9f-f697-406e-ba69-16a825292f42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:07.560555 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e037dc9f-f697-406e-ba69-16a825292f42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:07.567531 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e037dc9f-f697-406e-ba69-16a825292f42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:07.567977 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e037dc9f-f697-406e-ba69-16a825292f42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:07.568987 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e037dc9f-f697-406e-ba69-16a825292f42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:07.569447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e037dc9f-f697-406e-ba69-16a825292f42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:07.701782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e037dc9f-f697-406e-ba69-16a825292f42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:07.710701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e037dc9f-f697-406e-ba69-16a825292f42 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.154520 Jul 28 06:40:07.711462 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 233/453] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:07 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:07.724138 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-68e6c929-e059-4734-b97d-5a1f6ed5d2ab tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:07.724772 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-68e6c929-e059-4734-b97d-5a1f6ed5d2ab tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:07.732111 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-68e6c929-e059-4734-b97d-5a1f6ed5d2ab tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:07.732562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-68e6c929-e059-4734-b97d-5a1f6ed5d2ab tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:07.733365 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-68e6c929-e059-4734-b97d-5a1f6ed5d2ab tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:07.733805 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-68e6c929-e059-4734-b97d-5a1f6ed5d2ab tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:07.869742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-68e6c929-e059-4734-b97d-5a1f6ed5d2ab tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:07.877358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-68e6c929-e059-4734-b97d-5a1f6ed5d2ab tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.158060 Jul 28 06:40:07.877919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 221/454] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:07 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:08.024753 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-df468a30-eff5-4bf3-b6d4-3b2d41e2771c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:08.025441 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-df468a30-eff5-4bf3-b6d4-3b2d41e2771c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:08.031800 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df468a30-eff5-4bf3-b6d4-3b2d41e2771c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.032261 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df468a30-eff5-4bf3-b6d4-3b2d41e2771c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.033086 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df468a30-eff5-4bf3-b6d4-3b2d41e2771c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.033670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df468a30-eff5-4bf3-b6d4-3b2d41e2771c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.073794 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d4d0722d-2d7e-4ab1-88c7-a133caaddc83 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:08.074398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d4d0722d-2d7e-4ab1-88c7-a133caaddc83 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:08.080897 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d4d0722d-2d7e-4ab1-88c7-a133caaddc83 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.081665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d4d0722d-2d7e-4ab1-88c7-a133caaddc83 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.082447 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d4d0722d-2d7e-4ab1-88c7-a133caaddc83 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.082875 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d4d0722d-2d7e-4ab1-88c7-a133caaddc83 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.099184 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-df468a30-eff5-4bf3-b6d4-3b2d41e2771c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:08.111965 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-df468a30-eff5-4bf3-b6d4-3b2d41e2771c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.091052 Jul 28 06:40:08.112773 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 234/455] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:08 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:08.213857 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d4d0722d-2d7e-4ab1-88c7-a133caaddc83 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:08.221726 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d4d0722d-2d7e-4ab1-88c7-a133caaddc83 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.151718 Jul 28 06:40:08.222285 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 222/456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:08 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:08.262496 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7e7ed9c8-1751-4c79-bb9a-0753b9d9e3d9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:08.263631 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7e7ed9c8-1751-4c79-bb9a-0753b9d9e3d9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:08.271102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7e7ed9c8-1751-4c79-bb9a-0753b9d9e3d9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.271545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7e7ed9c8-1751-4c79-bb9a-0753b9d9e3d9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.272299 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7e7ed9c8-1751-4c79-bb9a-0753b9d9e3d9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.272729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7e7ed9c8-1751-4c79-bb9a-0753b9d9e3d9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.413733 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7e7ed9c8-1751-4c79-bb9a-0753b9d9e3d9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:08.421280 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7e7ed9c8-1751-4c79-bb9a-0753b9d9e3d9 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.164932 Jul 28 06:40:08.421854 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 235/457] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:08 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:08.544554 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-48de0242-ef54-4051-9550-8ac952eb78c2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:08.545144 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-48de0242-ef54-4051-9550-8ac952eb78c2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:08.551691 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48de0242-ef54-4051-9550-8ac952eb78c2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.552140 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48de0242-ef54-4051-9550-8ac952eb78c2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.552893 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48de0242-ef54-4051-9550-8ac952eb78c2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.553342 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48de0242-ef54-4051-9550-8ac952eb78c2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.682668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-48de0242-ef54-4051-9550-8ac952eb78c2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:08.691423 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-48de0242-ef54-4051-9550-8ac952eb78c2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:08.692925 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-48de0242-ef54-4051-9550-8ac952eb78c2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:08.694359 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-48de0242-ef54-4051-9550-8ac952eb78c2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.153839 Jul 28 06:40:08.694911 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 223/458] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:08 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:08.731819 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-835cd0ed-c738-47fd-a872-8615ac5decb7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:08.732434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-835cd0ed-c738-47fd-a872-8615ac5decb7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:08.739732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-835cd0ed-c738-47fd-a872-8615ac5decb7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.740182 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-835cd0ed-c738-47fd-a872-8615ac5decb7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.740952 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-835cd0ed-c738-47fd-a872-8615ac5decb7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.741420 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-835cd0ed-c738-47fd-a872-8615ac5decb7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.869109 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-835cd0ed-c738-47fd-a872-8615ac5decb7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:08.876443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-835cd0ed-c738-47fd-a872-8615ac5decb7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.148478 Jul 28 06:40:08.877029 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 236/459] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:08 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:08.897722 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-41592cc5-faad-4c2f-af52-ac42cd2b85cf tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:08.898359 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-41592cc5-faad-4c2f-af52-ac42cd2b85cf tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:08.904239 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-41592cc5-faad-4c2f-af52-ac42cd2b85cf tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.904682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-41592cc5-faad-4c2f-af52-ac42cd2b85cf tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:08.905461 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-41592cc5-faad-4c2f-af52-ac42cd2b85cf tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:08.905899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-41592cc5-faad-4c2f-af52-ac42cd2b85cf tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:09.041112 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-41592cc5-faad-4c2f-af52-ac42cd2b85cf tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:09.048473 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-41592cc5-faad-4c2f-af52-ac42cd2b85cf tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.154532 Jul 28 06:40:09.049684 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 224/460] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:08 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:09.133754 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b0fc4f14-d067-4351-8439-8da0d3620027 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:09.134396 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b0fc4f14-d067-4351-8439-8da0d3620027 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:09.140431 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0fc4f14-d067-4351-8439-8da0d3620027 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:09.140877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0fc4f14-d067-4351-8439-8da0d3620027 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:09.141667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0fc4f14-d067-4351-8439-8da0d3620027 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:09.142085 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0fc4f14-d067-4351-8439-8da0d3620027 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:09.215051 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b0fc4f14-d067-4351-8439-8da0d3620027 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:09.224072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b0fc4f14-d067-4351-8439-8da0d3620027 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.094071 Jul 28 06:40:09.225137 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 237/461] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:09 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:09.244957 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-8aa3a5f0-63ea-41b6-87f9-5664319ad584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:09.245693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-8aa3a5f0-63ea-41b6-87f9-5664319ad584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:09.251966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8aa3a5f0-63ea-41b6-87f9-5664319ad584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:09.252672 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8aa3a5f0-63ea-41b6-87f9-5664319ad584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:09.253426 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8aa3a5f0-63ea-41b6-87f9-5664319ad584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:09.253934 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8aa3a5f0-63ea-41b6-87f9-5664319ad584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:09.392311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8aa3a5f0-63ea-41b6-87f9-5664319ad584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:09.399926 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-8aa3a5f0-63ea-41b6-87f9-5664319ad584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.159043 Jul 28 06:40:09.400495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 225/462] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:09 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:09.443066 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-801bb1d9-e989-4840-afbe-9205d8c19458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:09.443949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-801bb1d9-e989-4840-afbe-9205d8c19458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:09.450192 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-801bb1d9-e989-4840-afbe-9205d8c19458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:09.450648 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-801bb1d9-e989-4840-afbe-9205d8c19458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:09.451419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-801bb1d9-e989-4840-afbe-9205d8c19458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:09.451859 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-801bb1d9-e989-4840-afbe-9205d8c19458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:09.582970 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-801bb1d9-e989-4840-afbe-9205d8c19458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:09.590363 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-801bb1d9-e989-4840-afbe-9205d8c19458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.152157 Jul 28 06:40:09.590921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 238/463] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:09 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:09.716429 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5bfd50b4-8f3e-48af-9067-e668865f7839 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:09.717045 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5bfd50b4-8f3e-48af-9067-e668865f7839 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:09.723812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5bfd50b4-8f3e-48af-9067-e668865f7839 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:09.724270 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5bfd50b4-8f3e-48af-9067-e668865f7839 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:09.725030 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5bfd50b4-8f3e-48af-9067-e668865f7839 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:09.725508 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5bfd50b4-8f3e-48af-9067-e668865f7839 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:09.897623 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-06e2c8bf-b9bb-4c13-9464-defc19d987fc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:09.898246 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-06e2c8bf-b9bb-4c13-9464-defc19d987fc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:09.905798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-06e2c8bf-b9bb-4c13-9464-defc19d987fc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:09.906260 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-06e2c8bf-b9bb-4c13-9464-defc19d987fc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:09.907043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-06e2c8bf-b9bb-4c13-9464-defc19d987fc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:09.907483 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-06e2c8bf-b9bb-4c13-9464-defc19d987fc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:10.052725 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-06e2c8bf-b9bb-4c13-9464-defc19d987fc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:10.060460 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-06e2c8bf-b9bb-4c13-9464-defc19d987fc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.166729 Jul 28 06:40:10.061124 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 239/464] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:09 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:10.078621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0d554bf7-9466-457b-ac99-c130f39d5b50 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:10.079563 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0d554bf7-9466-457b-ac99-c130f39d5b50 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:10.082766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5bfd50b4-8f3e-48af-9067-e668865f7839 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:10.086282 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d554bf7-9466-457b-ac99-c130f39d5b50 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:10.086842 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d554bf7-9466-457b-ac99-c130f39d5b50 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:10.087619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d554bf7-9466-457b-ac99-c130f39d5b50 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:10.088063 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d554bf7-9466-457b-ac99-c130f39d5b50 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:10.090619 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5bfd50b4-8f3e-48af-9067-e668865f7839 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:10.092123 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5bfd50b4-8f3e-48af-9067-e668865f7839 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:10.093278 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5bfd50b4-8f3e-48af-9067-e668865f7839 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.380800 Jul 28 06:40:10.093854 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 226/465] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:09 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:10.221392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0d554bf7-9466-457b-ac99-c130f39d5b50 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:10.228815 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0d554bf7-9466-457b-ac99-c130f39d5b50 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.154099 Jul 28 06:40:10.229408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 240/466] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:10 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:10.247497 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1ab73ad9-4691-4071-95ca-f3ea26a328fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:10.248032 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1ab73ad9-4691-4071-95ca-f3ea26a328fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:10.254765 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1ab73ad9-4691-4071-95ca-f3ea26a328fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:10.255211 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1ab73ad9-4691-4071-95ca-f3ea26a328fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:10.256109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1ab73ad9-4691-4071-95ca-f3ea26a328fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:10.256599 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1ab73ad9-4691-4071-95ca-f3ea26a328fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:10.273831 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:10.321489 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1ab73ad9-4691-4071-95ca-f3ea26a328fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:10.330630 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1ab73ad9-4691-4071-95ca-f3ea26a328fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.086268 Jul 28 06:40:10.331394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 227/467] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:10 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:10.420678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-99420882-d17a-4719-9612-8adc98818c7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:10.421400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-99420882-d17a-4719-9612-8adc98818c7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:10.428393 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-99420882-d17a-4719-9612-8adc98818c7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:10.428929 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-99420882-d17a-4719-9612-8adc98818c7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:10.429808 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-99420882-d17a-4719-9612-8adc98818c7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:10.430251 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-99420882-d17a-4719-9612-8adc98818c7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:10.566088 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-99420882-d17a-4719-9612-8adc98818c7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:10.574027 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-99420882-d17a-4719-9612-8adc98818c7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.157233 Jul 28 06:40:10.574605 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 241/468] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:10 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:10.611588 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-16f9d13b-79db-42c6-8d39-c35d8ae4670e tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:10.612227 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-16f9d13b-79db-42c6-8d39-c35d8ae4670e tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:10.618577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16f9d13b-79db-42c6-8d39-c35d8ae4670e tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:10.619103 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16f9d13b-79db-42c6-8d39-c35d8ae4670e tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:10.619937 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16f9d13b-79db-42c6-8d39-c35d8ae4670e tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:10.620435 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16f9d13b-79db-42c6-8d39-c35d8ae4670e tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:10.766264 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-16f9d13b-79db-42c6-8d39-c35d8ae4670e tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:10.774702 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-16f9d13b-79db-42c6-8d39-c35d8ae4670e tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.167165 Jul 28 06:40:10.780399 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 228/469] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:10 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:11.082181 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-bca6e067-cbb1-4653-b7c9-7ff1cdce4ee4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:11.082724 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-bca6e067-cbb1-4653-b7c9-7ff1cdce4ee4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:11.088869 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bca6e067-cbb1-4653-b7c9-7ff1cdce4ee4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.089348 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bca6e067-cbb1-4653-b7c9-7ff1cdce4ee4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.090121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bca6e067-cbb1-4653-b7c9-7ff1cdce4ee4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.090561 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bca6e067-cbb1-4653-b7c9-7ff1cdce4ee4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.094473 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:11.117523 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-910e1be0-a64c-41eb-a103-80f4d06a8019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:11.118134 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-910e1be0-a64c-41eb-a103-80f4d06a8019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:11.124371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-910e1be0-a64c-41eb-a103-80f4d06a8019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.124822 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-910e1be0-a64c-41eb-a103-80f4d06a8019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.125630 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-910e1be0-a64c-41eb-a103-80f4d06a8019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.126064 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-910e1be0-a64c-41eb-a103-80f4d06a8019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.226174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-bca6e067-cbb1-4653-b7c9-7ff1cdce4ee4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:11.234244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-bca6e067-cbb1-4653-b7c9-7ff1cdce4ee4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1509 microversion: 2.1 time: 0.156111 Jul 28 06:40:11.234822 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 242/470] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:11 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:11.249435 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-13b4e1e5-d2a5-4bf1-8269-861e34f27000 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:11.250061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-13b4e1e5-d2a5-4bf1-8269-861e34f27000 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:11.256090 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13b4e1e5-d2a5-4bf1-8269-861e34f27000 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.256541 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13b4e1e5-d2a5-4bf1-8269-861e34f27000 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.257361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13b4e1e5-d2a5-4bf1-8269-861e34f27000 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.257820 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-13b4e1e5-d2a5-4bf1-8269-861e34f27000 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.263930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-910e1be0-a64c-41eb-a103-80f4d06a8019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:11.273031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-910e1be0-a64c-41eb-a103-80f4d06a8019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:11.274670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-910e1be0-a64c-41eb-a103-80f4d06a8019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:11.275913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-910e1be0-a64c-41eb-a103-80f4d06a8019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.162261 Jul 28 06:40:11.276556 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 229/471] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:11 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:11.366162 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f2b2ae8c-bf76-4254-856d-32a7a4efa6b7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:11.366162 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f2b2ae8c-bf76-4254-856d-32a7a4efa6b7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:11.366162 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2b2ae8c-bf76-4254-856d-32a7a4efa6b7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.366162 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2b2ae8c-bf76-4254-856d-32a7a4efa6b7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.366496 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2b2ae8c-bf76-4254-856d-32a7a4efa6b7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.366496 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2b2ae8c-bf76-4254-856d-32a7a4efa6b7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.395262 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-13b4e1e5-d2a5-4bf1-8269-861e34f27000 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:11.402784 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-13b4e1e5-d2a5-4bf1-8269-861e34f27000 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.157330 Jul 28 06:40:11.403362 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 243/472] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:11 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:11.408808 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-02400320-3289-4deb-8b24-8cbb13204bc0 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c5e28d9-218d-42ee-bf45-5930d2312788", "device": "/dev/sdb"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:11.412143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-02400320-3289-4deb-8b24-8cbb13204bc0 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:11.418256 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-02400320-3289-4deb-8b24-8cbb13204bc0 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.418701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-02400320-3289-4deb-8b24-8cbb13204bc0 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.419474 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-02400320-3289-4deb-8b24-8cbb13204bc0 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.419907 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-02400320-3289-4deb-8b24-8cbb13204bc0 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.426273 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f2b2ae8c-bf76-4254-856d-32a7a4efa6b7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:11.433957 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f2b2ae8c-bf76-4254-856d-32a7a4efa6b7 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.085371 Jul 28 06:40:11.441660 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 230/473] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:11 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:11.595536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e8186ab7-b78d-4d77-9ee1-205fc146540d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:11.596863 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e8186ab7-b78d-4d77-9ee1-205fc146540d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:11.602891 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e8186ab7-b78d-4d77-9ee1-205fc146540d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.603342 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e8186ab7-b78d-4d77-9ee1-205fc146540d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.604104 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e8186ab7-b78d-4d77-9ee1-205fc146540d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.604542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e8186ab7-b78d-4d77-9ee1-205fc146540d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.734542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e8186ab7-b78d-4d77-9ee1-205fc146540d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:11.742601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e8186ab7-b78d-4d77-9ee1-205fc146540d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.151032 Jul 28 06:40:11.743162 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 231/474] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:11 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:11.794987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c3f13f19-223e-4551-b464-ad47cd90f458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:11.795600 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c3f13f19-223e-4551-b464-ad47cd90f458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:11.803182 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c3f13f19-223e-4551-b464-ad47cd90f458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.803182 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c3f13f19-223e-4551-b464-ad47cd90f458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.803182 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c3f13f19-223e-4551-b464-ad47cd90f458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:11.803625 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c3f13f19-223e-4551-b464-ad47cd90f458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:11.934572 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c3f13f19-223e-4551-b464-ad47cd90f458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:11.943228 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c3f13f19-223e-4551-b464-ad47cd90f458 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.151969 Jul 28 06:40:11.944106 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 232/475] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:11 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:12.256867 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c216c37d-b58d-4323-bf81-cf02a4786458 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:12.257648 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c216c37d-b58d-4323-bf81-cf02a4786458 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:12.266548 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c216c37d-b58d-4323-bf81-cf02a4786458 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:12.267054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c216c37d-b58d-4323-bf81-cf02a4786458 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:12.268198 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c216c37d-b58d-4323-bf81-cf02a4786458 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:12.269541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c216c37d-b58d-4323-bf81-cf02a4786458 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:12.401276 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c216c37d-b58d-4323-bf81-cf02a4786458 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:12.408896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c216c37d-b58d-4323-bf81-cf02a4786458 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1515 microversion: 2.1 time: 0.156861 Jul 28 06:40:12.409477 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 233/476] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:12 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:12.413868 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2036da30-da15-449e-9754-6505eb2c9dce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:12.414460 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2036da30-da15-449e-9754-6505eb2c9dce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:12.422538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2036da30-da15-449e-9754-6505eb2c9dce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:12.422994 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2036da30-da15-449e-9754-6505eb2c9dce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:12.429996 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2036da30-da15-449e-9754-6505eb2c9dce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:12.429996 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2036da30-da15-449e-9754-6505eb2c9dce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:12.576460 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2036da30-da15-449e-9754-6505eb2c9dce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:12.586280 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2036da30-da15-449e-9754-6505eb2c9dce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:12.587963 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2036da30-da15-449e-9754-6505eb2c9dce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:12.589149 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2036da30-da15-449e-9754-6505eb2c9dce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.178760 Jul 28 06:40:12.589746 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 234/477] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:12 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:12.610581 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-66764b25-33a0-4673-a3b3-aaac3ca79cbc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:12.611807 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-66764b25-33a0-4673-a3b3-aaac3ca79cbc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:12.618362 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-66764b25-33a0-4673-a3b3-aaac3ca79cbc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:12.618814 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-66764b25-33a0-4673-a3b3-aaac3ca79cbc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:12.619583 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-66764b25-33a0-4673-a3b3-aaac3ca79cbc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:12.620022 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-66764b25-33a0-4673-a3b3-aaac3ca79cbc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:12.773727 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-66764b25-33a0-4673-a3b3-aaac3ca79cbc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:12.781580 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-66764b25-33a0-4673-a3b3-aaac3ca79cbc tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.174758 Jul 28 06:40:12.782357 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 235/478] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:12 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:12.787906 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b402ab08-21df-4c92-977d-0bf4e9ecb10d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:12.788528 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b402ab08-21df-4c92-977d-0bf4e9ecb10d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:12.797824 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b402ab08-21df-4c92-977d-0bf4e9ecb10d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:12.798384 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b402ab08-21df-4c92-977d-0bf4e9ecb10d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:12.799730 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b402ab08-21df-4c92-977d-0bf4e9ecb10d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:12.800167 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b402ab08-21df-4c92-977d-0bf4e9ecb10d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:12.875853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b402ab08-21df-4c92-977d-0bf4e9ecb10d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:12.883666 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b402ab08-21df-4c92-977d-0bf4e9ecb10d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.100443 Jul 28 06:40:12.884234 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 236/479] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:12 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:12.888610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1c99b726-e42d-4290-aa98-e0260f7e9fd2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:12.889206 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1c99b726-e42d-4290-aa98-e0260f7e9fd2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:12.895605 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1c99b726-e42d-4290-aa98-e0260f7e9fd2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:12.896047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1c99b726-e42d-4290-aa98-e0260f7e9fd2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:12.896872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1c99b726-e42d-4290-aa98-e0260f7e9fd2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:12.897315 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1c99b726-e42d-4290-aa98-e0260f7e9fd2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:13.027193 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1c99b726-e42d-4290-aa98-e0260f7e9fd2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:13.036111 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1c99b726-e42d-4290-aa98-e0260f7e9fd2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.150456 Jul 28 06:40:13.036682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 237/480] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:12 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:13.041063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2e8d6db4-06f1-48aa-86b3-420d7c828b7b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:13.041693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2e8d6db4-06f1-48aa-86b3-420d7c828b7b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:13.047541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e8d6db4-06f1-48aa-86b3-420d7c828b7b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:13.047981 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e8d6db4-06f1-48aa-86b3-420d7c828b7b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:13.049827 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e8d6db4-06f1-48aa-86b3-420d7c828b7b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:13.049827 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e8d6db4-06f1-48aa-86b3-420d7c828b7b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:13.177095 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2e8d6db4-06f1-48aa-86b3-420d7c828b7b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:13.184492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2e8d6db4-06f1-48aa-86b3-420d7c828b7b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.146878 Jul 28 06:40:13.185044 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 238/481] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:13 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:13.613616 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-49e28f75-6a90-4844-87ec-44d165d2373d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:13.614227 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-49e28f75-6a90-4844-87ec-44d165d2373d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:13.616090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:13.621644 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-49e28f75-6a90-4844-87ec-44d165d2373d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:13.622031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-49e28f75-6a90-4844-87ec-44d165d2373d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:13.622794 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-49e28f75-6a90-4844-87ec-44d165d2373d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:13.623224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-49e28f75-6a90-4844-87ec-44d165d2373d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:13.758465 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-49e28f75-6a90-4844-87ec-44d165d2373d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:13.767964 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-49e28f75-6a90-4844-87ec-44d165d2373d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:13.769473 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-49e28f75-6a90-4844-87ec-44d165d2373d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:13.770811 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-49e28f75-6a90-4844-87ec-44d165d2373d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.161140 Jul 28 06:40:13.771373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 239/482] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:13 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:13.803847 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1212d805-f63f-4712-9b7f-e84c0803562f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:13.804435 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1212d805-f63f-4712-9b7f-e84c0803562f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:13.810393 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1212d805-f63f-4712-9b7f-e84c0803562f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:13.810834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1212d805-f63f-4712-9b7f-e84c0803562f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:13.811585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1212d805-f63f-4712-9b7f-e84c0803562f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:13.812012 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1212d805-f63f-4712-9b7f-e84c0803562f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:13.944555 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1212d805-f63f-4712-9b7f-e84c0803562f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:13.951976 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1212d805-f63f-4712-9b7f-e84c0803562f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.151887 Jul 28 06:40:13.952544 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 240/483] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:13 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:13.957612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3dde9df7-222a-44cd-bd9c-e602e250026c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:13.958210 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3dde9df7-222a-44cd-bd9c-e602e250026c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:13.963926 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3dde9df7-222a-44cd-bd9c-e602e250026c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:13.964370 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3dde9df7-222a-44cd-bd9c-e602e250026c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:13.965124 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3dde9df7-222a-44cd-bd9c-e602e250026c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:13.965662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3dde9df7-222a-44cd-bd9c-e602e250026c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:14.026753 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3dde9df7-222a-44cd-bd9c-e602e250026c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:14.035007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3dde9df7-222a-44cd-bd9c-e602e250026c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.081498 Jul 28 06:40:14.035668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 241/484] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:13 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:14.061587 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0546cc6f-3283-47b4-a25e-a53325d1c7b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:14.062200 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0546cc6f-3283-47b4-a25e-a53325d1c7b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:14.068720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0546cc6f-3283-47b4-a25e-a53325d1c7b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:14.069169 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0546cc6f-3283-47b4-a25e-a53325d1c7b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:14.069958 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0546cc6f-3283-47b4-a25e-a53325d1c7b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:14.070399 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0546cc6f-3283-47b4-a25e-a53325d1c7b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:14.201167 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0546cc6f-3283-47b4-a25e-a53325d1c7b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:14.209030 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0546cc6f-3283-47b4-a25e-a53325d1c7b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.151140 Jul 28 06:40:14.209627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 242/485] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:14 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:14.214037 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-fd60b4b3-dca8-44b0-a54e-87eb2944518a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:14.214635 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-fd60b4b3-dca8-44b0-a54e-87eb2944518a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:14.220122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd60b4b3-dca8-44b0-a54e-87eb2944518a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:14.221632 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd60b4b3-dca8-44b0-a54e-87eb2944518a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:14.222398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd60b4b3-dca8-44b0-a54e-87eb2944518a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:14.222833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd60b4b3-dca8-44b0-a54e-87eb2944518a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:14.352730 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-fd60b4b3-dca8-44b0-a54e-87eb2944518a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:14.360511 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-fd60b4b3-dca8-44b0-a54e-87eb2944518a tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.149927 Jul 28 06:40:14.361090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 243/486] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:14 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:14.795330 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3e50d22e-6f9f-4d04-8e00-2ed4d1d2f0d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:14.795936 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3e50d22e-6f9f-4d04-8e00-2ed4d1d2f0d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:14.802347 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3e50d22e-6f9f-4d04-8e00-2ed4d1d2f0d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:14.802802 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3e50d22e-6f9f-4d04-8e00-2ed4d1d2f0d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:14.803569 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3e50d22e-6f9f-4d04-8e00-2ed4d1d2f0d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:14.804001 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3e50d22e-6f9f-4d04-8e00-2ed4d1d2f0d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:14.806708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:14.940747 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3e50d22e-6f9f-4d04-8e00-2ed4d1d2f0d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:14.949073 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3e50d22e-6f9f-4d04-8e00-2ed4d1d2f0d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:14.950632 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3e50d22e-6f9f-4d04-8e00-2ed4d1d2f0d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:14.951786 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3e50d22e-6f9f-4d04-8e00-2ed4d1d2f0d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.160597 Jul 28 06:40:14.952337 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 244/487] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:14 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:14.972173 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-61d7bb0b-3203-4c16-a813-f541402f18a5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:14.972773 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-61d7bb0b-3203-4c16-a813-f541402f18a5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:14.978800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61d7bb0b-3203-4c16-a813-f541402f18a5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:14.979237 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61d7bb0b-3203-4c16-a813-f541402f18a5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:14.979994 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61d7bb0b-3203-4c16-a813-f541402f18a5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:14.980427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61d7bb0b-3203-4c16-a813-f541402f18a5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:15.113367 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-61d7bb0b-3203-4c16-a813-f541402f18a5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:15.120731 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-61d7bb0b-3203-4c16-a813-f541402f18a5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.152747 Jul 28 06:40:15.121286 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 245/488] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:14 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:15.125645 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-814f4f82-b167-475d-925f-5092318c0913 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:15.126266 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-814f4f82-b167-475d-925f-5092318c0913 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:15.132661 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-814f4f82-b167-475d-925f-5092318c0913 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:15.133108 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-814f4f82-b167-475d-925f-5092318c0913 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:15.133901 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-814f4f82-b167-475d-925f-5092318c0913 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:15.134335 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-814f4f82-b167-475d-925f-5092318c0913 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:15.196314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-814f4f82-b167-475d-925f-5092318c0913 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:15.203632 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-814f4f82-b167-475d-925f-5092318c0913 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.081337 Jul 28 06:40:15.204192 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 246/489] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:15 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:15.230073 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bb69b6b0-e9a5-4def-ac46-008a47b14306 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:15.230708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bb69b6b0-e9a5-4def-ac46-008a47b14306 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:15.237092 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bb69b6b0-e9a5-4def-ac46-008a47b14306 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:15.237570 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bb69b6b0-e9a5-4def-ac46-008a47b14306 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:15.238340 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bb69b6b0-e9a5-4def-ac46-008a47b14306 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:15.238774 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bb69b6b0-e9a5-4def-ac46-008a47b14306 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:15.373976 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bb69b6b0-e9a5-4def-ac46-008a47b14306 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:15.382463 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bb69b6b0-e9a5-4def-ac46-008a47b14306 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.156001 Jul 28 06:40:15.383028 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 247/490] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:15 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:15.387415 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c4e39c90-3f50-4396-9137-a39364536bf3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:15.388120 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c4e39c90-3f50-4396-9137-a39364536bf3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:15.394078 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c4e39c90-3f50-4396-9137-a39364536bf3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:15.394519 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c4e39c90-3f50-4396-9137-a39364536bf3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:15.395263 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c4e39c90-3f50-4396-9137-a39364536bf3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:15.395735 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c4e39c90-3f50-4396-9137-a39364536bf3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:15.598945 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c4e39c90-3f50-4396-9137-a39364536bf3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:15.606564 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c4e39c90-3f50-4396-9137-a39364536bf3 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.222610 Jul 28 06:40:15.607132 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 248/491] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:15 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:15.916492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0e4fe54a-631f-41b1-b8dd-dcf00f841ffe tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'create', calling method: .version_select at 0x7f574c0f2ee0>, body: {"keypair": {"name": "tempest-keypair-1788729281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDPDr/xBKqevL4LbHVvXa7eV7q72un6+Lv2bkl96WwVrkO95c75GogUrs64rXOfQtbebL89k/wLC/OrnNZfCKBOBvo26XoCaXXAMUrqnck/7WewOpGj3VLzjBSOa38pEA=="}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:15.932360 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-0e4fe54a-631f-41b1-b8dd-dcf00f841ffe tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Getting quotas for project 0fb2f4ad616e43f5a9a248390bd0aebf. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:40:15.936126 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-0e4fe54a-631f-41b1-b8dd-dcf00f841ffe tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Getting quotas for user a2080efc6cbd471995593012bc268765 and project 0fb2f4ad616e43f5a9a248390bd0aebf. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:40:15.958168 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0e4fe54a-631f-41b1-b8dd-dcf00f841ffe tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045608 Jul 28 06:40:15.958763 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 249/492] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Jul 28 06:40:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:40:15.975110 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-27e9cd4b-15cb-44da-9075-1433dd74b6e5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:15.975721 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-27e9cd4b-15cb-44da-9075-1433dd74b6e5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:15.981691 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-27e9cd4b-15cb-44da-9075-1433dd74b6e5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:15.982139 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-27e9cd4b-15cb-44da-9075-1433dd74b6e5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:15.982900 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-27e9cd4b-15cb-44da-9075-1433dd74b6e5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:15.983338 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-27e9cd4b-15cb-44da-9075-1433dd74b6e5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:16.184649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-27e9cd4b-15cb-44da-9075-1433dd74b6e5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:16.200219 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-27e9cd4b-15cb-44da-9075-1433dd74b6e5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:16.211736 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-27e9cd4b-15cb-44da-9075-1433dd74b6e5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:16.212973 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-27e9cd4b-15cb-44da-9075-1433dd74b6e5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1743 microversion: 2.20 time: 0.241645 Jul 28 06:40:16.213771 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 250/493] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:15 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1743 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:16.218753 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-876fde23-5546-46c8-bf1b-c0a10446c2e3 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:16.219562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-876fde23-5546-46c8-bf1b-c0a10446c2e3 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:16.227081 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-876fde23-5546-46c8-bf1b-c0a10446c2e3 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:16.227462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-876fde23-5546-46c8-bf1b-c0a10446c2e3 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:16.228228 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-876fde23-5546-46c8-bf1b-c0a10446c2e3 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:16.228745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-876fde23-5546-46c8-bf1b-c0a10446c2e3 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:16.402768 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-876fde23-5546-46c8-bf1b-c0a10446c2e3 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:16.413610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-876fde23-5546-46c8-bf1b-c0a10446c2e3 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.197947 Jul 28 06:40:16.414843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 251/494] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:16 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:16.421224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-21e1b282-1f20-4b4e-aa31-85c6353e2f6a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:16.421224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-21e1b282-1f20-4b4e-aa31-85c6353e2f6a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:16.427913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-21e1b282-1f20-4b4e-aa31-85c6353e2f6a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:16.428469 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-21e1b282-1f20-4b4e-aa31-85c6353e2f6a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:16.429338 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-21e1b282-1f20-4b4e-aa31-85c6353e2f6a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:16.429804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-21e1b282-1f20-4b4e-aa31-85c6353e2f6a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:16.558191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-02400320-3289-4deb-8b24-8cbb13204bc0 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "POST /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.153536 Jul 28 06:40:16.559822 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 244/495] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:40:11 2022] POST /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7/os-volume_attachments => generated 194 bytes in 5156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:40:16.567123 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4efa312f-b04b-4624-b860-86db406c40b0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:16.567882 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4efa312f-b04b-4624-b860-86db406c40b0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:16.575179 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4efa312f-b04b-4624-b860-86db406c40b0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:16.576211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4efa312f-b04b-4624-b860-86db406c40b0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:16.577374 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4efa312f-b04b-4624-b860-86db406c40b0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:16.577883 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4efa312f-b04b-4624-b860-86db406c40b0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:16.615854 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-21e1b282-1f20-4b4e-aa31-85c6353e2f6a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:16.625707 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-21e1b282-1f20-4b4e-aa31-85c6353e2f6a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.209753 Jul 28 06:40:16.640128 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 252/496] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:16 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:16.647108 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b7e82fdb-e721-4971-aec8-2968419d1d6b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:16.647733 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b7e82fdb-e721-4971-aec8-2968419d1d6b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:16.654439 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7e82fdb-e721-4971-aec8-2968419d1d6b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:16.654887 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7e82fdb-e721-4971-aec8-2968419d1d6b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:16.656711 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7e82fdb-e721-4971-aec8-2968419d1d6b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:16.657157 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7e82fdb-e721-4971-aec8-2968419d1d6b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:16.734964 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4efa312f-b04b-4624-b860-86db406c40b0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:16.743516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4efa312f-b04b-4624-b860-86db406c40b0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.181448 Jul 28 06:40:16.744116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 245/497] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:16 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:16.989655 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b7e82fdb-e721-4971-aec8-2968419d1d6b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:17.004278 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b7e82fdb-e721-4971-aec8-2968419d1d6b tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1504 microversion: 2.1 time: 0.363915 Jul 28 06:40:17.018113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 253/498] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:16 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:17.237902 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-90ec749b-1e59-4fa5-865a-ae66e2251f5f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:17.238521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-90ec749b-1e59-4fa5-865a-ae66e2251f5f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:17.247573 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90ec749b-1e59-4fa5-865a-ae66e2251f5f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:17.247573 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90ec749b-1e59-4fa5-865a-ae66e2251f5f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:17.248126 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90ec749b-1e59-4fa5-865a-ae66e2251f5f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:17.248817 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90ec749b-1e59-4fa5-865a-ae66e2251f5f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:17.252689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-54ccf124-f606-4357-8003-5550f1502537 req-3384faa0-8c36-41fd-9610-3b71fe72b8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c8cbe2-7d60-4ddb-b580-02fd7b8d7148", "name": "network-vif-deleted", "tag": "3e5d434a-57c7-43e3-a3af-c419d61fcc19"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:17.271646 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-54ccf124-f606-4357-8003-5550f1502537 req-3384faa0-8c36-41fd-9610-3b71fe72b8fe service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:17.272346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-54ccf124-f606-4357-8003-5550f1502537 req-3384faa0-8c36-41fd-9610-3b71fe72b8fe service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:17.285014 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-54ccf124-f606-4357-8003-5550f1502537 req-3384faa0-8c36-41fd-9610-3b71fe72b8fe service nova] Creating event network-vif-deleted:3e5d434a-57c7-43e3-a3af-c419d61fcc19 for instance 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 on hv-cinder-85060 Jul 28 06:40:17.290581 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-54ccf124-f606-4357-8003-5550f1502537 req-3384faa0-8c36-41fd-9610-3b71fe72b8fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043478 Jul 28 06:40:17.291195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 254/499] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:40:17.444627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5af0fc4f-0e8b-4cdd-8e44-f5025d6ea194 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:17.445350 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5af0fc4f-0e8b-4cdd-8e44-f5025d6ea194 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:17.456267 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5af0fc4f-0e8b-4cdd-8e44-f5025d6ea194 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:17.456717 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5af0fc4f-0e8b-4cdd-8e44-f5025d6ea194 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:17.457993 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5af0fc4f-0e8b-4cdd-8e44-f5025d6ea194 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:17.457993 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5af0fc4f-0e8b-4cdd-8e44-f5025d6ea194 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:17.467612 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-90ec749b-1e59-4fa5-865a-ae66e2251f5f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:17.486396 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-90ec749b-1e59-4fa5-865a-ae66e2251f5f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:17.495177 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-90ec749b-1e59-4fa5-865a-ae66e2251f5f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:17.496663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-90ec749b-1e59-4fa5-865a-ae66e2251f5f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.264385 Jul 28 06:40:17.497701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 246/500] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:17 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:17.605374 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5af0fc4f-0e8b-4cdd-8e44-f5025d6ea194 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:17.614835 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5af0fc4f-0e8b-4cdd-8e44-f5025d6ea194 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.175812 Jul 28 06:40:17.615527 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 255/501] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:17 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:17.650864 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-216dc307-4cfe-4561-9f3c-a5a7806d2b30 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:17.652749 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-216dc307-4cfe-4561-9f3c-a5a7806d2b30 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:17.660399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-216dc307-4cfe-4561-9f3c-a5a7806d2b30 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:17.660843 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-216dc307-4cfe-4561-9f3c-a5a7806d2b30 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:17.661705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-216dc307-4cfe-4561-9f3c-a5a7806d2b30 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:17.662143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-216dc307-4cfe-4561-9f3c-a5a7806d2b30 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:17.764035 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-77721faf-9353-4559-ad1c-efcbc7295f71 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:17.764654 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-77721faf-9353-4559-ad1c-efcbc7295f71 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:17.771098 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-216dc307-4cfe-4561-9f3c-a5a7806d2b30 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:17.772812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77721faf-9353-4559-ad1c-efcbc7295f71 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:17.773263 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77721faf-9353-4559-ad1c-efcbc7295f71 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:17.774087 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77721faf-9353-4559-ad1c-efcbc7295f71 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:17.774517 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77721faf-9353-4559-ad1c-efcbc7295f71 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:17.778890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-216dc307-4cfe-4561-9f3c-a5a7806d2b30 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1293 microversion: 2.1 time: 0.134252 Jul 28 06:40:17.779539 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 247/502] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:17 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1293 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:17.973914 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-77721faf-9353-4559-ad1c-efcbc7295f71 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:17.981533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-77721faf-9353-4559-ad1c-efcbc7295f71 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.221296 Jul 28 06:40:17.982108 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 256/503] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:17 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:18.025688 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5e4f4671-4ab7-4563-bef7-d7b3d661d408 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:18.026373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5e4f4671-4ab7-4563-bef7-d7b3d661d408 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:18.032818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e4f4671-4ab7-4563-bef7-d7b3d661d408 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:18.033449 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e4f4671-4ab7-4563-bef7-d7b3d661d408 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:18.034225 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e4f4671-4ab7-4563-bef7-d7b3d661d408 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:18.034744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e4f4671-4ab7-4563-bef7-d7b3d661d408 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:18.085666 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1986151364", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e0d957c-26b4-458e-ac0c-afc92b508943"}], "security_groups": [{"name": "tempest-securitygroup--2067647967"}], "key_name": "tempest-keypair-1788729281", "user_data": "}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:18.097815 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5e4f4671-4ab7-4563-bef7-d7b3d661d408 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:18.105584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5e4f4671-4ab7-4563-bef7-d7b3d661d408 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1298 microversion: 2.1 time: 0.083682 Jul 28 06:40:18.106141 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 248/504] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:18 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:18.193519 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.network.neutron [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] validate_networks() for [('2e0d957c-26b4-458e-ac0c-afc92b508943', None, None, None, None, None)] {{(pid=124562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:40:18.521030 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-764baab6-0249-423f-b6b3-c60cea22d04b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:18.521751 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-764baab6-0249-423f-b6b3-c60cea22d04b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:18.527750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-764baab6-0249-423f-b6b3-c60cea22d04b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:18.528215 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-764baab6-0249-423f-b6b3-c60cea22d04b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:18.528966 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-764baab6-0249-423f-b6b3-c60cea22d04b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:18.529425 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-764baab6-0249-423f-b6b3-c60cea22d04b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:18.566320 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Flavor limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:40:18.566872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Image limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:40:18.567448 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Flavor pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:40:18.567956 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Image pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:40:18.568738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:40:18.578417 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:18.578933 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:18.580848 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:18.581494 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:18.599422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Getting quotas for project 0fb2f4ad616e43f5a9a248390bd0aebf. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:40:18.604048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Getting quotas for user a2080efc6cbd471995593012bc268765 and project 0fb2f4ad616e43f5a9a248390bd0aebf. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:40:18.616686 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Going to run 1 instances... {{(pid=124562) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:40:18.619016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:40:18.666497 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-764baab6-0249-423f-b6b3-c60cea22d04b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:18.669056 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-13eda0f6-6cfa-4962-9a9b-59f8f693a9c1 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.587665 Jul 28 06:40:18.669939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 257/505] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:40:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 06:40:18.674965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-214a0a33-634e-452f-9467-a54afd49ac35 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:18.675662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-214a0a33-634e-452f-9467-a54afd49ac35 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:18.682249 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-214a0a33-634e-452f-9467-a54afd49ac35 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:18.682694 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-214a0a33-634e-452f-9467-a54afd49ac35 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:18.683456 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-214a0a33-634e-452f-9467-a54afd49ac35 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:18.683882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-214a0a33-634e-452f-9467-a54afd49ac35 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:18.690650 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-764baab6-0249-423f-b6b3-c60cea22d04b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:18.695180 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-764baab6-0249-423f-b6b3-c60cea22d04b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:18.699106 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-764baab6-0249-423f-b6b3-c60cea22d04b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.181992 Jul 28 06:40:18.717776 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 249/506] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:18 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:18.725691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-494fa5a0-fdcc-4cc0-aca1-e8201d266d98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:18.726306 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-494fa5a0-fdcc-4cc0-aca1-e8201d266d98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:18.795111 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-494fa5a0-fdcc-4cc0-aca1-e8201d266d98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:18.803686 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-494fa5a0-fdcc-4cc0-aca1-e8201d266d98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1246 microversion: 2.1 time: 0.084723 Jul 28 06:40:18.804890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 250/507] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:18 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:18.809834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-048a1542-7af1-42a3-822f-2cecfe52cb35 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:18.810634 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-048a1542-7af1-42a3-822f-2cecfe52cb35 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:18.819673 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-048a1542-7af1-42a3-822f-2cecfe52cb35 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:18.820429 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-048a1542-7af1-42a3-822f-2cecfe52cb35 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:18.821238 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-048a1542-7af1-42a3-822f-2cecfe52cb35 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:18.821687 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-048a1542-7af1-42a3-822f-2cecfe52cb35 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:18.852201 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-214a0a33-634e-452f-9467-a54afd49ac35 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:18.860420 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-214a0a33-634e-452f-9467-a54afd49ac35 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1266 microversion: 2.1 time: 0.189310 Jul 28 06:40:18.862398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 258/508] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:18 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:18.888427 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-048a1542-7af1-42a3-822f-2cecfe52cb35 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:18.897331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-048a1542-7af1-42a3-822f-2cecfe52cb35 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1301 microversion: 2.1 time: 0.091248 Jul 28 06:40:18.898155 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 251/509] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:18 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:19.005643 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0e5fe398-bc05-4745-ad86-311a939901e7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:19.006827 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0e5fe398-bc05-4745-ad86-311a939901e7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:19.015130 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0e5fe398-bc05-4745-ad86-311a939901e7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:19.015678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0e5fe398-bc05-4745-ad86-311a939901e7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:19.016372 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0e5fe398-bc05-4745-ad86-311a939901e7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:19.017198 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0e5fe398-bc05-4745-ad86-311a939901e7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:19.127820 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a9987644-0206-426c-b209-a200b2551343 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:19.128758 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a9987644-0206-426c-b209-a200b2551343 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:19.136709 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a9987644-0206-426c-b209-a200b2551343 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:19.138014 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a9987644-0206-426c-b209-a200b2551343 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:19.138880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a9987644-0206-426c-b209-a200b2551343 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:19.139377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a9987644-0206-426c-b209-a200b2551343 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:19.158492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0e5fe398-bc05-4745-ad86-311a939901e7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:19.168157 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0e5fe398-bc05-4745-ad86-311a939901e7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.169265 Jul 28 06:40:19.169376 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 259/510] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:18 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:19.212061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a9987644-0206-426c-b209-a200b2551343 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:19.219596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a9987644-0206-426c-b209-a200b2551343 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1298 microversion: 2.1 time: 0.096355 Jul 28 06:40:19.220732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 252/511] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:19 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:19.730463 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bb0e86ce-ec15-4b30-a425-5645488fe6c0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:19.731417 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bb0e86ce-ec15-4b30-a425-5645488fe6c0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:19.739013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bb0e86ce-ec15-4b30-a425-5645488fe6c0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:19.741326 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bb0e86ce-ec15-4b30-a425-5645488fe6c0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:19.742391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bb0e86ce-ec15-4b30-a425-5645488fe6c0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:19.743189 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bb0e86ce-ec15-4b30-a425-5645488fe6c0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:19.826287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-caeb79c9-9d27-4ddf-8c3e-f5ee85bef806 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:19.828255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-caeb79c9-9d27-4ddf-8c3e-f5ee85bef806 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:19.841834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-caeb79c9-9d27-4ddf-8c3e-f5ee85bef806 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:19.846408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-caeb79c9-9d27-4ddf-8c3e-f5ee85bef806 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:19.847529 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-caeb79c9-9d27-4ddf-8c3e-f5ee85bef806 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:19.851641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-caeb79c9-9d27-4ddf-8c3e-f5ee85bef806 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:19.932688 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-caeb79c9-9d27-4ddf-8c3e-f5ee85bef806 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:19.942710 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-caeb79c9-9d27-4ddf-8c3e-f5ee85bef806 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1250 microversion: 2.1 time: 0.121104 Jul 28 06:40:19.944735 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 253/512] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:19 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1250 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:19.952177 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d85d210d-79f5-4c73-b32d-55a4b272525b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:19.953046 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d85d210d-79f5-4c73-b32d-55a4b272525b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:19.955545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:19.970820 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d85d210d-79f5-4c73-b32d-55a4b272525b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:19.971718 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d85d210d-79f5-4c73-b32d-55a4b272525b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:19.977948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d85d210d-79f5-4c73-b32d-55a4b272525b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:19.977948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d85d210d-79f5-4c73-b32d-55a4b272525b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.005922 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bb0e86ce-ec15-4b30-a425-5645488fe6c0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:20.014431 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bb0e86ce-ec15-4b30-a425-5645488fe6c0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:20.016579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bb0e86ce-ec15-4b30-a425-5645488fe6c0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:20.017992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bb0e86ce-ec15-4b30-a425-5645488fe6c0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.291424 Jul 28 06:40:20.018713 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 260/513] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:19 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:20.024186 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f97f5eb0-6b26-4687-ac93-05c8a8e94d4f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:20.025145 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f97f5eb0-6b26-4687-ac93-05c8a8e94d4f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:20.031412 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f97f5eb0-6b26-4687-ac93-05c8a8e94d4f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.031857 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f97f5eb0-6b26-4687-ac93-05c8a8e94d4f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.033139 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f97f5eb0-6b26-4687-ac93-05c8a8e94d4f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.033603 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f97f5eb0-6b26-4687-ac93-05c8a8e94d4f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.106122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f97f5eb0-6b26-4687-ac93-05c8a8e94d4f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:20.115116 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f97f5eb0-6b26-4687-ac93-05c8a8e94d4f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1299 microversion: 2.1 time: 0.095216 Jul 28 06:40:20.130982 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 261/514] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:20 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:20.191745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-310e8671-9845-437e-876e-69fbac02f25a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:20.193685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-310e8671-9845-437e-876e-69fbac02f25a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:20.216049 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-310e8671-9845-437e-876e-69fbac02f25a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.216049 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-310e8671-9845-437e-876e-69fbac02f25a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.216049 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-310e8671-9845-437e-876e-69fbac02f25a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.216555 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-310e8671-9845-437e-876e-69fbac02f25a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.405193 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-310e8671-9845-437e-876e-69fbac02f25a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:20.415864 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-310e8671-9845-437e-876e-69fbac02f25a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.229444 Jul 28 06:40:20.425381 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 262/515] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:20 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:20.435462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:20.436497 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:20.449796 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.451279 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d85d210d-79f5-4c73-b32d-55a4b272525b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:20.451643 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.452693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.453325 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.461901 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d85d210d-79f5-4c73-b32d-55a4b272525b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1453 microversion: 2.1 time: 0.515584 Jul 28 06:40:20.463515 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 254/516] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:19 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1453 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:20.475001 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:20.496128 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ce9ce7fb-4cbe-4257-9ff4-1429072f9eeb tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:20.502655 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ce9ce7fb-4cbe-4257-9ff4-1429072f9eeb tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:20.511779 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce9ce7fb-4cbe-4257-9ff4-1429072f9eeb tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.513680 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce9ce7fb-4cbe-4257-9ff4-1429072f9eeb tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.516200 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce9ce7fb-4cbe-4257-9ff4-1429072f9eeb tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.516818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce9ce7fb-4cbe-4257-9ff4-1429072f9eeb tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.518218 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.519041 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.519862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lazy-loading 'fault' on Instance uuid 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:40:20.574534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc6812703254c51a4200abf3dee2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57601f159e244aa68924602c2c5dc385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:20.586031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c270d67c-7522-412c-9b39-d9dcbf8b4073 tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 200 len: 1303 microversion: 2.1 time: 0.159145 Jul 28 06:40:20.587598 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 263/517] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:20 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 1303 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:20.748927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ce9ce7fb-4cbe-4257-9ff4-1429072f9eeb tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:20.761720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ce9ce7fb-4cbe-4257-9ff4-1429072f9eeb tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1453 microversion: 2.1 time: 0.273804 Jul 28 06:40:20.770317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 255/518] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:20 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1453 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:20.967047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7ceab5c9-9bff-4a05-a2f0-13d3c7cc85e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:20.968024 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7ceab5c9-9bff-4a05-a2f0-13d3c7cc85e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:20.976808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ceab5c9-9bff-4a05-a2f0-13d3c7cc85e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.978308 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ceab5c9-9bff-4a05-a2f0-13d3c7cc85e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:20.979433 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ceab5c9-9bff-4a05-a2f0-13d3c7cc85e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:20.980120 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ceab5c9-9bff-4a05-a2f0-13d3c7cc85e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:21.043080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dcc262b2-b35a-40c6-b535-ed4f5028a0f1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:21.045118 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-dcc262b2-b35a-40c6-b535-ed4f5028a0f1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:21.069447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcc262b2-b35a-40c6-b535-ed4f5028a0f1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:21.070791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcc262b2-b35a-40c6-b535-ed4f5028a0f1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:21.071835 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcc262b2-b35a-40c6-b535-ed4f5028a0f1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:21.072611 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcc262b2-b35a-40c6-b535-ed4f5028a0f1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:21.105343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7ceab5c9-9bff-4a05-a2f0-13d3c7cc85e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:21.121113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7ceab5c9-9bff-4a05-a2f0-13d3c7cc85e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1242 microversion: 2.1 time: 0.158384 Jul 28 06:40:21.124005 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 264/519] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:20 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:21.140065 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-fdd1e9f3-ce62-45b4-9698-df0312804e37 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:21.142796 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-fdd1e9f3-ce62-45b4-9698-df0312804e37 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:21.168942 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fdd1e9f3-ce62-45b4-9698-df0312804e37 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:21.169709 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fdd1e9f3-ce62-45b4-9698-df0312804e37 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:21.170672 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fdd1e9f3-ce62-45b4-9698-df0312804e37 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:21.173091 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fdd1e9f3-ce62-45b4-9698-df0312804e37 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:21.415239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dcc262b2-b35a-40c6-b535-ed4f5028a0f1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:21.424933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dcc262b2-b35a-40c6-b535-ed4f5028a0f1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:21.428423 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dcc262b2-b35a-40c6-b535-ed4f5028a0f1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:21.429890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-dcc262b2-b35a-40c6-b535-ed4f5028a0f1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.390663 Jul 28 06:40:21.430675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 256/520] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:21 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:21.461062 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f2a2037c-34c5-470b-8858-c13105f94f4a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:21.462713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f2a2037c-34c5-470b-8858-c13105f94f4a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:21.477702 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f2a2037c-34c5-470b-8858-c13105f94f4a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:21.479559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f2a2037c-34c5-470b-8858-c13105f94f4a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:21.483425 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f2a2037c-34c5-470b-8858-c13105f94f4a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:21.483977 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f2a2037c-34c5-470b-8858-c13105f94f4a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:21.689079 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f2a2037c-34c5-470b-8858-c13105f94f4a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:21.707643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f2a2037c-34c5-470b-8858-c13105f94f4a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.252244 Jul 28 06:40:21.707643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 257/521] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:21 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:21.723412 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-52e03644-60d4-456c-be1f-c61abe5cd02c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:21.724020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-52e03644-60d4-456c-be1f-c61abe5cd02c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] [instance: 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:21.734053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-52e03644-60d4-456c-be1f-c61abe5cd02c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:21.734495 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-52e03644-60d4-456c-be1f-c61abe5cd02c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:21.735266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-52e03644-60d4-456c-be1f-c61abe5cd02c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:21.735805 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-52e03644-60d4-456c-be1f-c61abe5cd02c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:21.786052 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-52e03644-60d4-456c-be1f-c61abe5cd02c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] HTTP exception thrown: Instance 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 could not be found. Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-52e03644-60d4-456c-be1f-c61abe5cd02c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Request method failure captured: Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 HTTP/1.1 Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i8DL8NsrhrhVxSGTb8qzaJDnqNVzl4QkBU7L2yoQiF2rzBN9q5VCfA-UkPUHjOnl8yB6uGNyOwvSFNzMp4qR4dYbtaQV9__lQLJZn3WegkI41CnJ_a2wt99k-n4zb9q-G3X1RJlWqF7s0t6NEjCZLqsqIXduMANbF1AKcCXNdfACMI Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: 57601f159e244aa68924602c2c5dc385 Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-VolumesActionsTest-392965626 Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:40:21.794592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57601f159e244aa68924602c2c5dc385", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57601f159e244aa68924602c2c5dc385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57601f159e244aa68924602c2c5dc385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57601f159e244aa68924602c2c5dc385"}]}] Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-VolumesActionsTest-392965626 Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: 57601f159e244aa68924602c2c5dc385 Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-VolumesActionsTest-392965626 Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-VolumesActionsTest-392965626-project Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: ffc6812703254c51a4200abf3dee2d95 Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-VolumesActionsTest-392965626-project Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 could not be found. Jul 28 06:40:21.796175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '37c8cbe2-7d60-4ddb-b580-02fd7b8d7148'} Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 could not be found. Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:40:21.797060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 could not be found. Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 could not be found. Jul 28 06:40:21.799160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:40:21.801690 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-52e03644-60d4-456c-be1f-c61abe5cd02c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] Returning 404 to user: Instance 37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:40:21.802598 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-52e03644-60d4-456c-be1f-c61abe5cd02c tempest-VolumesActionsTest-392965626 tempest-VolumesActionsTest-392965626-project] 10.222.0.20 "GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148" status: 404 len: 111 microversion: 2.1 time: 0.097642 Jul 28 06:40:21.818081 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 258/522] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:21 2022] GET /compute/v2.1/servers/37c8cbe2-7d60-4ddb-b580-02fd7b8d7148 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:40:21.848042 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-fdd1e9f3-ce62-45b4-9698-df0312804e37 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:21.857159 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-fdd1e9f3-ce62-45b4-9698-df0312804e37 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1299 microversion: 2.1 time: 0.720907 Jul 28 06:40:21.868769 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 265/523] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:21 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1299 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:22.149651 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7cbb8043-67a8-4e39-b253-7d8e0402bfe9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:22.150501 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7cbb8043-67a8-4e39-b253-7d8e0402bfe9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:22.168635 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7cbb8043-67a8-4e39-b253-7d8e0402bfe9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:22.171572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7cbb8043-67a8-4e39-b253-7d8e0402bfe9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:22.175631 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7cbb8043-67a8-4e39-b253-7d8e0402bfe9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:22.179197 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7cbb8043-67a8-4e39-b253-7d8e0402bfe9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:22.274550 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:22.457596 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-150ef2f4-64c8-4c9e-bc07-2abc24821c70 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:22.458471 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-150ef2f4-64c8-4c9e-bc07-2abc24821c70 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:22.472559 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-150ef2f4-64c8-4c9e-bc07-2abc24821c70 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:22.479803 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-150ef2f4-64c8-4c9e-bc07-2abc24821c70 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:22.486801 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-150ef2f4-64c8-4c9e-bc07-2abc24821c70 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:22.487404 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-150ef2f4-64c8-4c9e-bc07-2abc24821c70 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:22.599645 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7cbb8043-67a8-4e39-b253-7d8e0402bfe9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:22.616069 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7cbb8043-67a8-4e39-b253-7d8e0402bfe9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1306 microversion: 2.1 time: 0.470666 Jul 28 06:40:22.622942 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 259/524] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:22 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1306 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:22.728087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6651825d-2ff7-4c65-b923-c775f3d02b7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:22.728729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6651825d-2ff7-4c65-b923-c775f3d02b7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:22.742864 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6651825d-2ff7-4c65-b923-c775f3d02b7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:22.745402 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6651825d-2ff7-4c65-b923-c775f3d02b7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:22.753136 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6651825d-2ff7-4c65-b923-c775f3d02b7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:22.754421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6651825d-2ff7-4c65-b923-c775f3d02b7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:22.929318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-150ef2f4-64c8-4c9e-bc07-2abc24821c70 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:22.963083 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-150ef2f4-64c8-4c9e-bc07-2abc24821c70 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:22.964617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-150ef2f4-64c8-4c9e-bc07-2abc24821c70 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:22.965865 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-150ef2f4-64c8-4c9e-bc07-2abc24821c70 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.513801 Jul 28 06:40:22.966909 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 266/525] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:22 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:22.985088 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2d8094bc-add7-4712-b775-558646c6d504 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:22.986129 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2d8094bc-add7-4712-b775-558646c6d504 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:23.007000 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d8094bc-add7-4712-b775-558646c6d504 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:23.007452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d8094bc-add7-4712-b775-558646c6d504 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:23.008451 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d8094bc-add7-4712-b775-558646c6d504 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:23.008897 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d8094bc-add7-4712-b775-558646c6d504 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:23.197239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6651825d-2ff7-4c65-b923-c775f3d02b7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:23.206688 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6651825d-2ff7-4c65-b923-c775f3d02b7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.482369 Jul 28 06:40:23.218109 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 260/526] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:22 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:23.648948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dd43b2e6-1ff4-47ed-8be4-54998ed6d0a3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:23.649764 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-dd43b2e6-1ff4-47ed-8be4-54998ed6d0a3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:23.688631 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd43b2e6-1ff4-47ed-8be4-54998ed6d0a3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:23.692019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd43b2e6-1ff4-47ed-8be4-54998ed6d0a3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:23.693861 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd43b2e6-1ff4-47ed-8be4-54998ed6d0a3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:23.698837 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2d8094bc-add7-4712-b775-558646c6d504 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:23.704062 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd43b2e6-1ff4-47ed-8be4-54998ed6d0a3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:23.729630 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2d8094bc-add7-4712-b775-558646c6d504 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.760955 Jul 28 06:40:23.741773 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 267/527] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:22 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:23.993637 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-11b6eb6b-cc95-43be-9ad1-9c412377aeb4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:23.994285 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-11b6eb6b-cc95-43be-9ad1-9c412377aeb4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:24.002173 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-11b6eb6b-cc95-43be-9ad1-9c412377aeb4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:24.002646 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-11b6eb6b-cc95-43be-9ad1-9c412377aeb4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:24.003346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-11b6eb6b-cc95-43be-9ad1-9c412377aeb4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:24.017907 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-11b6eb6b-cc95-43be-9ad1-9c412377aeb4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:24.135424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dd43b2e6-1ff4-47ed-8be4-54998ed6d0a3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:24.145693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-dd43b2e6-1ff4-47ed-8be4-54998ed6d0a3 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1304 microversion: 2.1 time: 0.501237 Jul 28 06:40:24.146683 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 261/528] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:23 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1304 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:24.243870 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-946ebe26-b7a9-484a-9e68-59c7de0eb582 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:24.245419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-946ebe26-b7a9-484a-9e68-59c7de0eb582 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:24.265220 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-946ebe26-b7a9-484a-9e68-59c7de0eb582 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:24.266193 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-946ebe26-b7a9-484a-9e68-59c7de0eb582 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:24.267267 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-946ebe26-b7a9-484a-9e68-59c7de0eb582 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:24.268946 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-946ebe26-b7a9-484a-9e68-59c7de0eb582 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:24.431547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-11b6eb6b-cc95-43be-9ad1-9c412377aeb4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:24.452034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-11b6eb6b-cc95-43be-9ad1-9c412377aeb4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:24.465077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-11b6eb6b-cc95-43be-9ad1-9c412377aeb4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:24.471582 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-11b6eb6b-cc95-43be-9ad1-9c412377aeb4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.481603 Jul 28 06:40:24.481641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-946ebe26-b7a9-484a-9e68-59c7de0eb582 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:24.491769 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 268/529] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:23 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:24.493681 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-946ebe26-b7a9-484a-9e68-59c7de0eb582 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.252955 Jul 28 06:40:24.494750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 262/530] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:24 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:24.754779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b712d8a6-773d-49a3-b4be-463b6b33527e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:24.755117 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b712d8a6-773d-49a3-b4be-463b6b33527e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:24.771730 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b712d8a6-773d-49a3-b4be-463b6b33527e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:24.777038 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b712d8a6-773d-49a3-b4be-463b6b33527e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:24.778113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b712d8a6-773d-49a3-b4be-463b6b33527e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:24.778840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b712d8a6-773d-49a3-b4be-463b6b33527e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:25.175438 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-fbe44a72-dc84-47ec-be60-8a95575cbc84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:25.181131 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-fbe44a72-dc84-47ec-be60-8a95575cbc84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:25.197697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fbe44a72-dc84-47ec-be60-8a95575cbc84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:25.198448 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fbe44a72-dc84-47ec-be60-8a95575cbc84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:25.202865 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fbe44a72-dc84-47ec-be60-8a95575cbc84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:25.204397 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fbe44a72-dc84-47ec-be60-8a95575cbc84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:25.234422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b712d8a6-773d-49a3-b4be-463b6b33527e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:25.256122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b712d8a6-773d-49a3-b4be-463b6b33527e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.504039 Jul 28 06:40:25.273638 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 269/531] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:24 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:25.288475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-ade4e209-7fce-40e6-87a9-175afc8b50e7 req-cf70c273-77c6-40c8-b747-41266bff1fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7df248c-2b87-417e-b113-ecce4d8c0840", "tag": "e2fc8e5d-c2ef-4ebe-97f9-f660cc1fec0a"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:25.300393 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-ade4e209-7fce-40e6-87a9-175afc8b50e7 req-cf70c273-77c6-40c8-b747-41266bff1fd8 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:25.301115 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-ade4e209-7fce-40e6-87a9-175afc8b50e7 req-cf70c273-77c6-40c8-b747-41266bff1fd8 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:25.317675 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-ade4e209-7fce-40e6-87a9-175afc8b50e7 req-cf70c273-77c6-40c8-b747-41266bff1fd8 service nova] Creating event network-changed:e2fc8e5d-c2ef-4ebe-97f9-f660cc1fec0a for instance b7df248c-2b87-417e-b113-ecce4d8c0840 on hv-cinder-85060 Jul 28 06:40:25.324343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-ade4e209-7fce-40e6-87a9-175afc8b50e7 req-cf70c273-77c6-40c8-b747-41266bff1fd8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039597 Jul 28 06:40:25.324943 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 270/532] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:40:25.456284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-cf2ba5a8-d53f-417f-8387-d349eae6a514 req-191c4664-3efc-4d37-8ff6-1aa29f265d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a882b29e-1e41-4e8d-a8ed-7cdd735d175e", "tag": "f779dd90-25ac-4b48-b542-655c148fc093"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:25.475182 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-cf2ba5a8-d53f-417f-8387-d349eae6a514 req-191c4664-3efc-4d37-8ff6-1aa29f265d16 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:25.477884 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-cf2ba5a8-d53f-417f-8387-d349eae6a514 req-191c4664-3efc-4d37-8ff6-1aa29f265d16 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:25.510005 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-cf2ba5a8-d53f-417f-8387-d349eae6a514 req-191c4664-3efc-4d37-8ff6-1aa29f265d16 service nova] Creating event network-changed:f779dd90-25ac-4b48-b542-655c148fc093 for instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e on hv-cinder-85060 Jul 28 06:40:25.557464 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-cf2ba5a8-d53f-417f-8387-d349eae6a514 req-191c4664-3efc-4d37-8ff6-1aa29f265d16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105997 Jul 28 06:40:25.558386 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 271/533] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:40:25.565313 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-709b5de7-90fc-4502-accb-8628ba51cfa5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:25.566144 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-709b5de7-90fc-4502-accb-8628ba51cfa5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:25.582890 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-709b5de7-90fc-4502-accb-8628ba51cfa5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:25.583525 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-709b5de7-90fc-4502-accb-8628ba51cfa5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:25.584308 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-709b5de7-90fc-4502-accb-8628ba51cfa5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:25.584738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-709b5de7-90fc-4502-accb-8628ba51cfa5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:25.612896 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-fbe44a72-dc84-47ec-be60-8a95575cbc84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:25.632139 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-fbe44a72-dc84-47ec-be60-8a95575cbc84 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.461939 Jul 28 06:40:25.632788 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 263/534] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:25 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:25.660415 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1102e7c6-c1d7-412c-a95d-52d28edfb527 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:25.661072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1102e7c6-c1d7-412c-a95d-52d28edfb527 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:25.668553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1102e7c6-c1d7-412c-a95d-52d28edfb527 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:25.669077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1102e7c6-c1d7-412c-a95d-52d28edfb527 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:25.670095 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1102e7c6-c1d7-412c-a95d-52d28edfb527 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:25.671154 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1102e7c6-c1d7-412c-a95d-52d28edfb527 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:25.801696 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-709b5de7-90fc-4502-accb-8628ba51cfa5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:25.815187 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-709b5de7-90fc-4502-accb-8628ba51cfa5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:25.818459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-709b5de7-90fc-4502-accb-8628ba51cfa5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:25.819962 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-709b5de7-90fc-4502-accb-8628ba51cfa5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.259323 Jul 28 06:40:25.820729 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 272/535] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:25 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:25.858839 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1102e7c6-c1d7-412c-a95d-52d28edfb527 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:25.871629 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1102e7c6-c1d7-412c-a95d-52d28edfb527 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.237693 Jul 28 06:40:25.873245 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 264/536] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:25 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:26.278012 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-84ef1c91-ebe7-42ba-92f0-732686a8a86c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:26.278720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-84ef1c91-ebe7-42ba-92f0-732686a8a86c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:26.290796 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84ef1c91-ebe7-42ba-92f0-732686a8a86c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:26.291340 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84ef1c91-ebe7-42ba-92f0-732686a8a86c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:26.292417 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84ef1c91-ebe7-42ba-92f0-732686a8a86c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:26.293072 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84ef1c91-ebe7-42ba-92f0-732686a8a86c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:26.450399 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-84ef1c91-ebe7-42ba-92f0-732686a8a86c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:26.460458 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-84ef1c91-ebe7-42ba-92f0-732686a8a86c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.186206 Jul 28 06:40:26.461259 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 273/537] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:26 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:26.654443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7b55f247-ba7a-451f-8988-00ae05996849 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:26.655055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7b55f247-ba7a-451f-8988-00ae05996849 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:26.672096 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7b55f247-ba7a-451f-8988-00ae05996849 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:26.676839 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7b55f247-ba7a-451f-8988-00ae05996849 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:26.678379 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7b55f247-ba7a-451f-8988-00ae05996849 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:26.678831 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7b55f247-ba7a-451f-8988-00ae05996849 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:26.841986 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7b55f247-ba7a-451f-8988-00ae05996849 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:26.845620 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-62a74232-4dc1-4f7d-95fd-aaf7aad05ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:26.846774 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-62a74232-4dc1-4f7d-95fd-aaf7aad05ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:26.853469 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-62a74232-4dc1-4f7d-95fd-aaf7aad05ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:26.854242 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-62a74232-4dc1-4f7d-95fd-aaf7aad05ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:26.855018 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-62a74232-4dc1-4f7d-95fd-aaf7aad05ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:26.855454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-62a74232-4dc1-4f7d-95fd-aaf7aad05ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:26.858687 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7b55f247-ba7a-451f-8988-00ae05996849 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.207982 Jul 28 06:40:26.859288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 265/538] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:26 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:26.902411 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-fc88ca64-f55e-4ec1-a90b-5cdc412ff29f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:26.903250 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-fc88ca64-f55e-4ec1-a90b-5cdc412ff29f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:26.912177 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fc88ca64-f55e-4ec1-a90b-5cdc412ff29f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:26.912934 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fc88ca64-f55e-4ec1-a90b-5cdc412ff29f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:26.914116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fc88ca64-f55e-4ec1-a90b-5cdc412ff29f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:26.918468 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fc88ca64-f55e-4ec1-a90b-5cdc412ff29f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:27.019970 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-62a74232-4dc1-4f7d-95fd-aaf7aad05ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:27.029497 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-62a74232-4dc1-4f7d-95fd-aaf7aad05ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:27.031416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-62a74232-4dc1-4f7d-95fd-aaf7aad05ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:27.033285 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-62a74232-4dc1-4f7d-95fd-aaf7aad05ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.191536 Jul 28 06:40:27.047595 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 274/539] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:26 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:27.105520 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-fc88ca64-f55e-4ec1-a90b-5cdc412ff29f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:27.116766 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-fc88ca64-f55e-4ec1-a90b-5cdc412ff29f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.227015 Jul 28 06:40:27.117963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 266/540] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:26 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:27.482564 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6be6a3ba-4ea2-4a2e-9983-0141e47253fb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:27.484439 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6be6a3ba-4ea2-4a2e-9983-0141e47253fb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:27.489412 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:27.498070 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6be6a3ba-4ea2-4a2e-9983-0141e47253fb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:27.498995 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6be6a3ba-4ea2-4a2e-9983-0141e47253fb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:27.500754 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6be6a3ba-4ea2-4a2e-9983-0141e47253fb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:27.502418 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6be6a3ba-4ea2-4a2e-9983-0141e47253fb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:27.684245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6be6a3ba-4ea2-4a2e-9983-0141e47253fb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:27.694939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6be6a3ba-4ea2-4a2e-9983-0141e47253fb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.216676 Jul 28 06:40:27.710278 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 275/541] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:27 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:27.718963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-2564b3cd-6927-4ac4-bedb-62cc899769e0 req-63af5fa7-46f4-4d94-9b78-30c5336fae1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9e64be-7751-4a35-9913-759b5aa65387", "name": "network-vif-plugged", "status": "completed", "tag": "547ddf0c-06c1-4016-890a-f31d53cfe707"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:27.744442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-2564b3cd-6927-4ac4-bedb-62cc899769e0 req-63af5fa7-46f4-4d94-9b78-30c5336fae1d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:27.744886 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-2564b3cd-6927-4ac4-bedb-62cc899769e0 req-63af5fa7-46f4-4d94-9b78-30c5336fae1d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:27.768180 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-2564b3cd-6927-4ac4-bedb-62cc899769e0 req-63af5fa7-46f4-4d94-9b78-30c5336fae1d service nova] Creating event network-vif-plugged:547ddf0c-06c1-4016-890a-f31d53cfe707 for instance 3e9e64be-7751-4a35-9913-759b5aa65387 on hv-cinder-85060 Jul 28 06:40:27.774254 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-2564b3cd-6927-4ac4-bedb-62cc899769e0 req-63af5fa7-46f4-4d94-9b78-30c5336fae1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058825 Jul 28 06:40:27.775379 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 267/542] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:40:27.880582 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ea32d7bd-04fc-4516-a98f-30b28fb062d4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:27.881186 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ea32d7bd-04fc-4516-a98f-30b28fb062d4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:27.887926 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ea32d7bd-04fc-4516-a98f-30b28fb062d4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:27.888366 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ea32d7bd-04fc-4516-a98f-30b28fb062d4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:27.889435 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ea32d7bd-04fc-4516-a98f-30b28fb062d4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:27.890067 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ea32d7bd-04fc-4516-a98f-30b28fb062d4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:28.035374 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ea32d7bd-04fc-4516-a98f-30b28fb062d4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:28.043906 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ea32d7bd-04fc-4516-a98f-30b28fb062d4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.167946 Jul 28 06:40:28.044678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 276/543] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:27 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:28.064378 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5aff5250-2d95-468a-893e-59ebb5c646c8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:28.065673 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5aff5250-2d95-468a-893e-59ebb5c646c8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:28.072295 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5aff5250-2d95-468a-893e-59ebb5c646c8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:28.072744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5aff5250-2d95-468a-893e-59ebb5c646c8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:28.073924 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5aff5250-2d95-468a-893e-59ebb5c646c8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:28.074761 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5aff5250-2d95-468a-893e-59ebb5c646c8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:28.139706 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-48776c0c-c063-4892-880a-f542fc713d10 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:28.140795 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-48776c0c-c063-4892-880a-f542fc713d10 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:28.150817 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48776c0c-c063-4892-880a-f542fc713d10 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:28.151887 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48776c0c-c063-4892-880a-f542fc713d10 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:28.153135 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48776c0c-c063-4892-880a-f542fc713d10 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:28.154365 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48776c0c-c063-4892-880a-f542fc713d10 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:28.248019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5aff5250-2d95-468a-893e-59ebb5c646c8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:28.257830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5aff5250-2d95-468a-893e-59ebb5c646c8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:28.259485 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5aff5250-2d95-468a-893e-59ebb5c646c8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:28.261333 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5aff5250-2d95-468a-893e-59ebb5c646c8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.201652 Jul 28 06:40:28.274451 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 268/544] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:28 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:28.369540 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-48776c0c-c063-4892-880a-f542fc713d10 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:28.379006 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-48776c0c-c063-4892-880a-f542fc713d10 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.244306 Jul 28 06:40:28.384612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 277/545] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:28 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:28.724828 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-550602f2-04d7-4b52-b2f7-85441f6c2984 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:28.725483 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-550602f2-04d7-4b52-b2f7-85441f6c2984 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:28.732289 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-550602f2-04d7-4b52-b2f7-85441f6c2984 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:28.732860 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-550602f2-04d7-4b52-b2f7-85441f6c2984 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:28.734300 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-550602f2-04d7-4b52-b2f7-85441f6c2984 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:28.734608 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-550602f2-04d7-4b52-b2f7-85441f6c2984 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:28.803361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:28.980289 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-550602f2-04d7-4b52-b2f7-85441f6c2984 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:28.995940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-550602f2-04d7-4b52-b2f7-85441f6c2984 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.274724 Jul 28 06:40:29.001841 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 269/546] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:28 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:29.071714 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a08ec989-d4fb-466b-a3b3-850c34a420e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:29.073985 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a08ec989-d4fb-466b-a3b3-850c34a420e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:29.078788 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:29.080043 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=10 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:29.101746 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a08ec989-d4fb-466b-a3b3-850c34a420e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:29.104134 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a08ec989-d4fb-466b-a3b3-850c34a420e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:29.109393 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a08ec989-d4fb-466b-a3b3-850c34a420e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:29.114420 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a08ec989-d4fb-466b-a3b3-850c34a420e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:29.291936 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-81064ce1-a0e9-4073-be31-8da116b46ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:29.293939 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-81064ce1-a0e9-4073-be31-8da116b46ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:29.316681 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81064ce1-a0e9-4073-be31-8da116b46ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:29.317352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81064ce1-a0e9-4073-be31-8da116b46ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:29.325541 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81064ce1-a0e9-4073-be31-8da116b46ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:29.326399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81064ce1-a0e9-4073-be31-8da116b46ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:29.344239 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a08ec989-d4fb-466b-a3b3-850c34a420e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:29.354238 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a08ec989-d4fb-466b-a3b3-850c34a420e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.289402 Jul 28 06:40:29.372520 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 278/547] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:29 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:29.412662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-dbfa2de5-6697-41b1-b63f-048a71129584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:29.414164 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-dbfa2de5-6697-41b1-b63f-048a71129584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:29.429919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dbfa2de5-6697-41b1-b63f-048a71129584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:29.430669 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dbfa2de5-6697-41b1-b63f-048a71129584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:29.432112 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dbfa2de5-6697-41b1-b63f-048a71129584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:29.432705 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dbfa2de5-6697-41b1-b63f-048a71129584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:29.664224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-dbfa2de5-6697-41b1-b63f-048a71129584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:29.669554 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-81064ce1-a0e9-4073-be31-8da116b46ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:29.682957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-81064ce1-a0e9-4073-be31-8da116b46ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:29.684668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-dbfa2de5-6697-41b1-b63f-048a71129584 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.284159 Jul 28 06:40:29.685561 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-81064ce1-a0e9-4073-be31-8da116b46ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:29.687169 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-81064ce1-a0e9-4073-be31-8da116b46ea9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.403319 Jul 28 06:40:29.698022 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 279/548] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:29 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:29.705423 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 270/549] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:29 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:30.026491 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-48fcc754-d857-48a4-9bb7-1639480dcc0f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:30.027149 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-48fcc754-d857-48a4-9bb7-1639480dcc0f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:30.034281 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48fcc754-d857-48a4-9bb7-1639480dcc0f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:30.034757 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48fcc754-d857-48a4-9bb7-1639480dcc0f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:30.035740 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48fcc754-d857-48a4-9bb7-1639480dcc0f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:30.035992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-48fcc754-d857-48a4-9bb7-1639480dcc0f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:30.234375 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-48fcc754-d857-48a4-9bb7-1639480dcc0f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:30.240969 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:30.248304 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-48fcc754-d857-48a4-9bb7-1639480dcc0f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.224005 Jul 28 06:40:30.249362 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 280/550] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:30 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:30.457464 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-007f36fd-e28f-49f1-9587-dc2c6a625d80 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:30.458825 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-007f36fd-e28f-49f1-9587-dc2c6a625d80 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:30.479327 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-007f36fd-e28f-49f1-9587-dc2c6a625d80 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:30.479781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-007f36fd-e28f-49f1-9587-dc2c6a625d80 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:30.480607 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-007f36fd-e28f-49f1-9587-dc2c6a625d80 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:30.481234 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-007f36fd-e28f-49f1-9587-dc2c6a625d80 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:30.716298 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-18f63a13-ef64-4fe0-bbbf-917f70f56d7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:30.716930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-18f63a13-ef64-4fe0-bbbf-917f70f56d7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:30.740922 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-18f63a13-ef64-4fe0-bbbf-917f70f56d7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:30.742204 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-18f63a13-ef64-4fe0-bbbf-917f70f56d7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:30.742581 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-18f63a13-ef64-4fe0-bbbf-917f70f56d7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:30.742951 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-18f63a13-ef64-4fe0-bbbf-917f70f56d7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:30.784434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-007f36fd-e28f-49f1-9587-dc2c6a625d80 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:30.796162 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-007f36fd-e28f-49f1-9587-dc2c6a625d80 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.350936 Jul 28 06:40:30.796744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 271/551] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:30 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:30.802061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f2875cd2-4344-4e00-b9f0-a71c4b6b4654 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:30.802670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f2875cd2-4344-4e00-b9f0-a71c4b6b4654 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:30.829936 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f2875cd2-4344-4e00-b9f0-a71c4b6b4654 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:30.830726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f2875cd2-4344-4e00-b9f0-a71c4b6b4654 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:30.832440 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f2875cd2-4344-4e00-b9f0-a71c4b6b4654 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:30.832440 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f2875cd2-4344-4e00-b9f0-a71c4b6b4654 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:31.005264 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-18f63a13-ef64-4fe0-bbbf-917f70f56d7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:31.018411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-18f63a13-ef64-4fe0-bbbf-917f70f56d7d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.311042 Jul 28 06:40:31.018985 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 281/552] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:30 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:31.135156 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f2875cd2-4344-4e00-b9f0-a71c4b6b4654 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:31.146276 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f2875cd2-4344-4e00-b9f0-a71c4b6b4654 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:31.148135 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f2875cd2-4344-4e00-b9f0-a71c4b6b4654 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:31.151781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f2875cd2-4344-4e00-b9f0-a71c4b6b4654 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.353394 Jul 28 06:40:31.152961 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 272/553] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:30 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:31.334724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e768f820-ad78-4372-bd49-3b59fdfcddfd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:31.334724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e768f820-ad78-4372-bd49-3b59fdfcddfd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:31.334724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e768f820-ad78-4372-bd49-3b59fdfcddfd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:31.334724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e768f820-ad78-4372-bd49-3b59fdfcddfd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:31.335836 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e768f820-ad78-4372-bd49-3b59fdfcddfd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:31.335836 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e768f820-ad78-4372-bd49-3b59fdfcddfd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:31.614731 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e768f820-ad78-4372-bd49-3b59fdfcddfd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:31.632009 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e768f820-ad78-4372-bd49-3b59fdfcddfd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.341050 Jul 28 06:40:31.632617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 282/554] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:31 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:31.820347 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c0e5bcc7-1380-40d9-9c92-b00406d87a8b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:31.820984 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c0e5bcc7-1380-40d9-9c92-b00406d87a8b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:31.827430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c0e5bcc7-1380-40d9-9c92-b00406d87a8b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:31.827887 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c0e5bcc7-1380-40d9-9c92-b00406d87a8b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:31.828669 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c0e5bcc7-1380-40d9-9c92-b00406d87a8b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:31.835365 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c0e5bcc7-1380-40d9-9c92-b00406d87a8b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:32.040745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d5a24a8c-4dd5-4f2c-b8f1-77a322e7d69b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:32.041276 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d5a24a8c-4dd5-4f2c-b8f1-77a322e7d69b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:32.054405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d5a24a8c-4dd5-4f2c-b8f1-77a322e7d69b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:32.054865 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d5a24a8c-4dd5-4f2c-b8f1-77a322e7d69b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:32.056088 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d5a24a8c-4dd5-4f2c-b8f1-77a322e7d69b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:32.056088 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d5a24a8c-4dd5-4f2c-b8f1-77a322e7d69b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:32.208948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c0e5bcc7-1380-40d9-9c92-b00406d87a8b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:32.231774 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c0e5bcc7-1380-40d9-9c92-b00406d87a8b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.408235 Jul 28 06:40:32.232310 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 273/555] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:31 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:32.271325 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7363f456-c26c-43de-a740-c92a654d4197 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:32.271941 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7363f456-c26c-43de-a740-c92a654d4197 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:32.283786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7363f456-c26c-43de-a740-c92a654d4197 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:32.284337 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7363f456-c26c-43de-a740-c92a654d4197 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:32.285076 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7363f456-c26c-43de-a740-c92a654d4197 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:32.285588 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7363f456-c26c-43de-a740-c92a654d4197 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:32.502928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d5a24a8c-4dd5-4f2c-b8f1-77a322e7d69b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:32.518918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d5a24a8c-4dd5-4f2c-b8f1-77a322e7d69b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.483416 Jul 28 06:40:32.520267 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 283/556] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:32 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:32.549234 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7363f456-c26c-43de-a740-c92a654d4197 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:32.558643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7363f456-c26c-43de-a740-c92a654d4197 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:32.560169 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7363f456-c26c-43de-a740-c92a654d4197 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:32.561383 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7363f456-c26c-43de-a740-c92a654d4197 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.301798 Jul 28 06:40:32.562261 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 274/557] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:32 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:32.668763 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-43c65a9c-e02d-40d5-b776-bdf044a155a6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:32.677549 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-43c65a9c-e02d-40d5-b776-bdf044a155a6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:32.736747 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43c65a9c-e02d-40d5-b776-bdf044a155a6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:32.738995 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43c65a9c-e02d-40d5-b776-bdf044a155a6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:32.740017 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43c65a9c-e02d-40d5-b776-bdf044a155a6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:32.740788 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43c65a9c-e02d-40d5-b776-bdf044a155a6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:33.155415 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-43c65a9c-e02d-40d5-b776-bdf044a155a6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:33.169871 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-43c65a9c-e02d-40d5-b776-bdf044a155a6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.510853 Jul 28 06:40:33.170745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 284/558] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:32 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:33.271480 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2207447c-ce3c-459c-b3b6-12771c3097dc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:33.275907 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2207447c-ce3c-459c-b3b6-12771c3097dc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:33.289212 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2207447c-ce3c-459c-b3b6-12771c3097dc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:33.295314 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2207447c-ce3c-459c-b3b6-12771c3097dc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:33.296367 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2207447c-ce3c-459c-b3b6-12771c3097dc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:33.297638 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2207447c-ce3c-459c-b3b6-12771c3097dc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:33.544744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-20092d0c-c2f2-42a1-982e-44d81e4585b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:33.545682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-20092d0c-c2f2-42a1-982e-44d81e4585b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:33.569160 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20092d0c-c2f2-42a1-982e-44d81e4585b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:33.569832 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20092d0c-c2f2-42a1-982e-44d81e4585b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:33.570767 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20092d0c-c2f2-42a1-982e-44d81e4585b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:33.573843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20092d0c-c2f2-42a1-982e-44d81e4585b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:33.875390 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2207447c-ce3c-459c-b3b6-12771c3097dc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:33.890175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2207447c-ce3c-459c-b3b6-12771c3097dc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.628656 Jul 28 06:40:33.906941 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 275/559] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:33 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:33.921950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4dc4f3ba-6e7e-44c6-8f6b-317ae8a57a1c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:33.923503 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4dc4f3ba-6e7e-44c6-8f6b-317ae8a57a1c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:33.934737 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4dc4f3ba-6e7e-44c6-8f6b-317ae8a57a1c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:33.935187 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4dc4f3ba-6e7e-44c6-8f6b-317ae8a57a1c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:33.936547 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4dc4f3ba-6e7e-44c6-8f6b-317ae8a57a1c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:33.937272 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4dc4f3ba-6e7e-44c6-8f6b-317ae8a57a1c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:33.978983 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:34.238628 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4dc4f3ba-6e7e-44c6-8f6b-317ae8a57a1c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:34.254235 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4dc4f3ba-6e7e-44c6-8f6b-317ae8a57a1c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:34.256004 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4dc4f3ba-6e7e-44c6-8f6b-317ae8a57a1c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:34.267216 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4dc4f3ba-6e7e-44c6-8f6b-317ae8a57a1c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1738 microversion: 2.20 time: 0.356364 Jul 28 06:40:34.269811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 276/560] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:33 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:34.280184 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dcacc44a-618d-48eb-aa92-0b7068970fdb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:34.286252 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-dcacc44a-618d-48eb-aa92-0b7068970fdb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:34.300318 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcacc44a-618d-48eb-aa92-0b7068970fdb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:34.302708 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcacc44a-618d-48eb-aa92-0b7068970fdb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:34.305900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcacc44a-618d-48eb-aa92-0b7068970fdb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:34.306538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dcacc44a-618d-48eb-aa92-0b7068970fdb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:34.325789 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-20092d0c-c2f2-42a1-982e-44d81e4585b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:34.336915 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-20092d0c-c2f2-42a1-982e-44d81e4585b1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.796727 Jul 28 06:40:34.337884 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 285/561] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:33 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:34.461319 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-99d941e5-1fd9-4761-a310-642c209751c2 req-bd7be8df-e3ec-4e9d-bc41-57c59372651f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a88fd0-386e-4cde-bddf-205dea943fc9", "tag": "fd589bac-7a7d-4978-bdbb-17282786c967"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:34.474618 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-99d941e5-1fd9-4761-a310-642c209751c2 req-bd7be8df-e3ec-4e9d-bc41-57c59372651f service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:34.478015 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-99d941e5-1fd9-4761-a310-642c209751c2 req-bd7be8df-e3ec-4e9d-bc41-57c59372651f service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:34.509454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-99d941e5-1fd9-4761-a310-642c209751c2 req-bd7be8df-e3ec-4e9d-bc41-57c59372651f service nova] Creating event network-changed:fd589bac-7a7d-4978-bdbb-17282786c967 for instance 65a88fd0-386e-4cde-bddf-205dea943fc9 on hv-cinder-85060 Jul 28 06:40:34.516776 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-99d941e5-1fd9-4761-a310-642c209751c2 req-bd7be8df-e3ec-4e9d-bc41-57c59372651f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061688 Jul 28 06:40:34.520182 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 286/562] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:40:34.540804 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dcacc44a-618d-48eb-aa92-0b7068970fdb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:34.567216 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-dcacc44a-618d-48eb-aa92-0b7068970fdb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.296255 Jul 28 06:40:34.567823 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 277/563] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:34 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:34.916898 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5bd05c57-f13a-4c5a-b03a-259fe893364c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:34.917538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5bd05c57-f13a-4c5a-b03a-259fe893364c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:34.925057 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5bd05c57-f13a-4c5a-b03a-259fe893364c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:34.925536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5bd05c57-f13a-4c5a-b03a-259fe893364c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:34.926307 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5bd05c57-f13a-4c5a-b03a-259fe893364c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:34.926739 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5bd05c57-f13a-4c5a-b03a-259fe893364c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:35.216450 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5bd05c57-f13a-4c5a-b03a-259fe893364c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:35.236458 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5bd05c57-f13a-4c5a-b03a-259fe893364c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.323489 Jul 28 06:40:35.238028 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 287/564] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:34 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:35.292012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-81f2f398-b4a1-4d4c-b15e-94af5f02790e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:35.293793 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-81f2f398-b4a1-4d4c-b15e-94af5f02790e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:35.303990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81f2f398-b4a1-4d4c-b15e-94af5f02790e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:35.304846 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81f2f398-b4a1-4d4c-b15e-94af5f02790e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:35.305858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81f2f398-b4a1-4d4c-b15e-94af5f02790e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:35.306615 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-81f2f398-b4a1-4d4c-b15e-94af5f02790e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:35.367362 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1e4fbd0e-805f-4fa3-a337-2dfa72f7b155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:35.369288 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1e4fbd0e-805f-4fa3-a337-2dfa72f7b155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:35.385666 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1e4fbd0e-805f-4fa3-a337-2dfa72f7b155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:35.387190 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1e4fbd0e-805f-4fa3-a337-2dfa72f7b155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:35.391340 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1e4fbd0e-805f-4fa3-a337-2dfa72f7b155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:35.393868 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1e4fbd0e-805f-4fa3-a337-2dfa72f7b155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:35.465816 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-81f2f398-b4a1-4d4c-b15e-94af5f02790e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:35.475139 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-81f2f398-b4a1-4d4c-b15e-94af5f02790e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:35.476938 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-81f2f398-b4a1-4d4c-b15e-94af5f02790e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:35.478508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-81f2f398-b4a1-4d4c-b15e-94af5f02790e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.190749 Jul 28 06:40:35.479547 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 278/565] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:35 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:35.592415 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-654dfbf4-96cd-4216-ad64-5eaa56171dfa tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:35.593008 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-654dfbf4-96cd-4216-ad64-5eaa56171dfa tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:35.611973 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-654dfbf4-96cd-4216-ad64-5eaa56171dfa tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:35.612628 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-654dfbf4-96cd-4216-ad64-5eaa56171dfa tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:35.613639 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-654dfbf4-96cd-4216-ad64-5eaa56171dfa tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:35.614288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-654dfbf4-96cd-4216-ad64-5eaa56171dfa tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:35.625434 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1e4fbd0e-805f-4fa3-a337-2dfa72f7b155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:35.633781 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1e4fbd0e-805f-4fa3-a337-2dfa72f7b155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.276578 Jul 28 06:40:35.635254 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 288/566] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:35 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:35.787735 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-654dfbf4-96cd-4216-ad64-5eaa56171dfa tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:35.795612 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-654dfbf4-96cd-4216-ad64-5eaa56171dfa tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.207153 Jul 28 06:40:35.801330 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 279/567] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:35 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:36.257898 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-43cf0c70-fa54-4cd2-b988-4265ad1510e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:36.258494 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-43cf0c70-fa54-4cd2-b988-4265ad1510e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:36.266263 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43cf0c70-fa54-4cd2-b988-4265ad1510e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:36.267529 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43cf0c70-fa54-4cd2-b988-4265ad1510e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:36.268509 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43cf0c70-fa54-4cd2-b988-4265ad1510e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:36.268942 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43cf0c70-fa54-4cd2-b988-4265ad1510e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:36.429260 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-43cf0c70-fa54-4cd2-b988-4265ad1510e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:36.437990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-43cf0c70-fa54-4cd2-b988-4265ad1510e6 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.183926 Jul 28 06:40:36.439956 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 289/568] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:36 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:36.504575 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d7eeeb7b-e813-4745-a247-223eaf143f3a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:36.505868 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d7eeeb7b-e813-4745-a247-223eaf143f3a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:36.513764 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7eeeb7b-e813-4745-a247-223eaf143f3a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:36.514214 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7eeeb7b-e813-4745-a247-223eaf143f3a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:36.514983 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7eeeb7b-e813-4745-a247-223eaf143f3a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:36.515419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7eeeb7b-e813-4745-a247-223eaf143f3a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:36.661073 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d7eeeb7b-e813-4745-a247-223eaf143f3a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:36.661528 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6f500f1d-4c0f-46ad-b4ec-a6a1191ec4e3 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:36.662615 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6f500f1d-4c0f-46ad-b4ec-a6a1191ec4e3 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:36.670951 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6f500f1d-4c0f-46ad-b4ec-a6a1191ec4e3 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:36.671486 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6f500f1d-4c0f-46ad-b4ec-a6a1191ec4e3 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:36.672376 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6f500f1d-4c0f-46ad-b4ec-a6a1191ec4e3 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:36.673606 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6f500f1d-4c0f-46ad-b4ec-a6a1191ec4e3 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:36.679147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d7eeeb7b-e813-4745-a247-223eaf143f3a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:36.686981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d7eeeb7b-e813-4745-a247-223eaf143f3a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:36.693668 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d7eeeb7b-e813-4745-a247-223eaf143f3a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.193257 Jul 28 06:40:36.695117 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 280/569] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:36 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:36.826123 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-97ca595b-3d56-4109-a2d5-0147a83670b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:36.827083 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-97ca595b-3d56-4109-a2d5-0147a83670b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:36.851341 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-97ca595b-3d56-4109-a2d5-0147a83670b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:36.852685 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-97ca595b-3d56-4109-a2d5-0147a83670b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:36.854756 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-97ca595b-3d56-4109-a2d5-0147a83670b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:36.855523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-97ca595b-3d56-4109-a2d5-0147a83670b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:36.856852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6f500f1d-4c0f-46ad-b4ec-a6a1191ec4e3 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:36.866727 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6f500f1d-4c0f-46ad-b4ec-a6a1191ec4e3 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.213579 Jul 28 06:40:36.868178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 290/570] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:36 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:37.028596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-97ca595b-3d56-4109-a2d5-0147a83670b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:37.037713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-97ca595b-3d56-4109-a2d5-0147a83670b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.221268 Jul 28 06:40:37.038506 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 281/571] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:36 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:37.460257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7d967691-e478-4e25-8471-4cacc9783f3f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:37.460872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7d967691-e478-4e25-8471-4cacc9783f3f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:37.467309 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d967691-e478-4e25-8471-4cacc9783f3f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:37.467969 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d967691-e478-4e25-8471-4cacc9783f3f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:37.468967 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d967691-e478-4e25-8471-4cacc9783f3f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:37.469435 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d967691-e478-4e25-8471-4cacc9783f3f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:37.624849 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7d967691-e478-4e25-8471-4cacc9783f3f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:37.637223 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7d967691-e478-4e25-8471-4cacc9783f3f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.180714 Jul 28 06:40:37.638191 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 291/572] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:37 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:37.718505 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a0b2a589-43f6-45ec-8a80-2f0d842b52fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:37.719115 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a0b2a589-43f6-45ec-8a80-2f0d842b52fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:37.732095 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0b2a589-43f6-45ec-8a80-2f0d842b52fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:37.733548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0b2a589-43f6-45ec-8a80-2f0d842b52fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:37.736875 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0b2a589-43f6-45ec-8a80-2f0d842b52fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:37.737719 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0b2a589-43f6-45ec-8a80-2f0d842b52fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:37.891101 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f2a2502e-3a6e-453d-84fa-f1124ac89a23 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:37.892133 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f2a2502e-3a6e-453d-84fa-f1124ac89a23 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:37.899969 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2a2502e-3a6e-453d-84fa-f1124ac89a23 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:37.900742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2a2502e-3a6e-453d-84fa-f1124ac89a23 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:37.902052 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2a2502e-3a6e-453d-84fa-f1124ac89a23 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:37.902840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2a2502e-3a6e-453d-84fa-f1124ac89a23 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:37.919677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a0b2a589-43f6-45ec-8a80-2f0d842b52fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:37.929128 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a0b2a589-43f6-45ec-8a80-2f0d842b52fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:37.933992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a0b2a589-43f6-45ec-8a80-2f0d842b52fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:37.935676 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a0b2a589-43f6-45ec-8a80-2f0d842b52fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.221719 Jul 28 06:40:37.941871 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 282/573] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:37 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:38.067835 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a6cb51f2-f94f-4910-b6ed-d385fe5507b0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:38.069141 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a6cb51f2-f94f-4910-b6ed-d385fe5507b0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:38.075798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a6cb51f2-f94f-4910-b6ed-d385fe5507b0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:38.076612 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a6cb51f2-f94f-4910-b6ed-d385fe5507b0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:38.077590 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a6cb51f2-f94f-4910-b6ed-d385fe5507b0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:38.078179 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a6cb51f2-f94f-4910-b6ed-d385fe5507b0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:38.093909 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f2a2502e-3a6e-453d-84fa-f1124ac89a23 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:38.104233 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f2a2502e-3a6e-453d-84fa-f1124ac89a23 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.217211 Jul 28 06:40:38.104824 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 292/574] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:37 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:38.243072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a6cb51f2-f94f-4910-b6ed-d385fe5507b0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:38.251303 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a6cb51f2-f94f-4910-b6ed-d385fe5507b0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.187644 Jul 28 06:40:38.252325 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 283/575] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:38 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:38.660233 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e149d761-7186-47c6-910c-1b3e326cf393 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:38.660942 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e149d761-7186-47c6-910c-1b3e326cf393 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:38.692616 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e149d761-7186-47c6-910c-1b3e326cf393 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:38.695265 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e149d761-7186-47c6-910c-1b3e326cf393 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:38.697284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e149d761-7186-47c6-910c-1b3e326cf393 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:38.698672 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e149d761-7186-47c6-910c-1b3e326cf393 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:38.895803 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e149d761-7186-47c6-910c-1b3e326cf393 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:38.903895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e149d761-7186-47c6-910c-1b3e326cf393 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.248428 Jul 28 06:40:38.904470 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 293/576] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:38 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:38.960690 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-59b49f5f-d94a-4c1a-967b-2c459a642275 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:38.961350 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-59b49f5f-d94a-4c1a-967b-2c459a642275 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:38.968121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59b49f5f-d94a-4c1a-967b-2c459a642275 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:38.968567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59b49f5f-d94a-4c1a-967b-2c459a642275 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:38.969338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59b49f5f-d94a-4c1a-967b-2c459a642275 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:38.970019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59b49f5f-d94a-4c1a-967b-2c459a642275 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:39.125752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-59b49f5f-d94a-4c1a-967b-2c459a642275 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:39.127939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-236f2a17-11f0-4742-9096-d29fedfbd155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:39.128766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-236f2a17-11f0-4742-9096-d29fedfbd155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:39.142920 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-59b49f5f-d94a-4c1a-967b-2c459a642275 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:39.147547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-236f2a17-11f0-4742-9096-d29fedfbd155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:39.147547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-236f2a17-11f0-4742-9096-d29fedfbd155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:39.147547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-236f2a17-11f0-4742-9096-d29fedfbd155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:39.147547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-236f2a17-11f0-4742-9096-d29fedfbd155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:39.156102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-59b49f5f-d94a-4c1a-967b-2c459a642275 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:39.157901 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-59b49f5f-d94a-4c1a-967b-2c459a642275 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.200839 Jul 28 06:40:39.158901 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 284/577] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:38 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:39.278277 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-7948b8bf-c851-4752-8600-28881335209d req-2b8750dd-ee58-4979-8732-9533260e7f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019e1e9c-7545-477a-bae9-47c555ae07e2", "name": "network-vif-unplugged", "status": "completed", "tag": "626917cf-1bf9-47dd-b3eb-784f6c8fdad0"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:39.295139 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-7948b8bf-c851-4752-8600-28881335209d req-2b8750dd-ee58-4979-8732-9533260e7f51 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:39.296001 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-7948b8bf-c851-4752-8600-28881335209d req-2b8750dd-ee58-4979-8732-9533260e7f51 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:39.318428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-7948b8bf-c851-4752-8600-28881335209d req-2b8750dd-ee58-4979-8732-9533260e7f51 service nova] Creating event network-vif-unplugged:626917cf-1bf9-47dd-b3eb-784f6c8fdad0 for instance 019e1e9c-7545-477a-bae9-47c555ae07e2 on hv-cinder-85060 Jul 28 06:40:39.325556 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-7948b8bf-c851-4752-8600-28881335209d req-2b8750dd-ee58-4979-8732-9533260e7f51 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057265 Jul 28 06:40:39.329899 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 285/578] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:40:39.346065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3940d440-5783-42e7-98f6-58606f3d8e15 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:39.346793 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3940d440-5783-42e7-98f6-58606f3d8e15 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:39.364236 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3940d440-5783-42e7-98f6-58606f3d8e15 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:39.364689 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3940d440-5783-42e7-98f6-58606f3d8e15 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:39.365511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3940d440-5783-42e7-98f6-58606f3d8e15 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:39.365943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3940d440-5783-42e7-98f6-58606f3d8e15 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:39.466735 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-236f2a17-11f0-4742-9096-d29fedfbd155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:39.475807 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-236f2a17-11f0-4742-9096-d29fedfbd155 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.353493 Jul 28 06:40:39.476567 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 294/579] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:39 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:39.595784 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3940d440-5783-42e7-98f6-58606f3d8e15 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:39.604882 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3940d440-5783-42e7-98f6-58606f3d8e15 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.271258 Jul 28 06:40:39.605911 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 286/580] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:39 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:39.924705 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6d1dd1ea-eba9-4a50-8321-221b87ee1c98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:39.925268 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6d1dd1ea-eba9-4a50-8321-221b87ee1c98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:39.931809 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d1dd1ea-eba9-4a50-8321-221b87ee1c98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:39.932271 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d1dd1ea-eba9-4a50-8321-221b87ee1c98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:39.933270 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d1dd1ea-eba9-4a50-8321-221b87ee1c98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:39.933736 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d1dd1ea-eba9-4a50-8321-221b87ee1c98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:40.073087 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6d1dd1ea-eba9-4a50-8321-221b87ee1c98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:40.088514 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6d1dd1ea-eba9-4a50-8321-221b87ee1c98 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.168339 Jul 28 06:40:40.101927 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 295/581] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:39 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:40.185267 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6bdc17b2-3602-4cc1-9a26-1684c72529b1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:40.186650 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6bdc17b2-3602-4cc1-9a26-1684c72529b1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:40.194499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6bdc17b2-3602-4cc1-9a26-1684c72529b1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:40.195274 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6bdc17b2-3602-4cc1-9a26-1684c72529b1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:40.196288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6bdc17b2-3602-4cc1-9a26-1684c72529b1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:40.196952 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6bdc17b2-3602-4cc1-9a26-1684c72529b1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:40.376313 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6bdc17b2-3602-4cc1-9a26-1684c72529b1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:40.384391 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6bdc17b2-3602-4cc1-9a26-1684c72529b1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:40.385948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6bdc17b2-3602-4cc1-9a26-1684c72529b1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:40.387138 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6bdc17b2-3602-4cc1-9a26-1684c72529b1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.206353 Jul 28 06:40:40.387689 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 287/582] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:40 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:40.497655 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-61dfa9d7-3c97-4c66-8005-3164d4277ea2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:40.498428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-61dfa9d7-3c97-4c66-8005-3164d4277ea2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:40.505704 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61dfa9d7-3c97-4c66-8005-3164d4277ea2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:40.506467 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61dfa9d7-3c97-4c66-8005-3164d4277ea2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:40.507345 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61dfa9d7-3c97-4c66-8005-3164d4277ea2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:40.507893 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61dfa9d7-3c97-4c66-8005-3164d4277ea2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:40.631886 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5b56501f-1790-4bfb-9d7d-409ac5486391 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:40.633431 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5b56501f-1790-4bfb-9d7d-409ac5486391 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:40.646789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b56501f-1790-4bfb-9d7d-409ac5486391 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:40.647949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b56501f-1790-4bfb-9d7d-409ac5486391 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:40.649919 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b56501f-1790-4bfb-9d7d-409ac5486391 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:40.650957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b56501f-1790-4bfb-9d7d-409ac5486391 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:40.698129 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-61dfa9d7-3c97-4c66-8005-3164d4277ea2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:40.712303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-61dfa9d7-3c97-4c66-8005-3164d4277ea2 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.217075 Jul 28 06:40:40.726451 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 296/583] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:40 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:40.836614 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5b56501f-1790-4bfb-9d7d-409ac5486391 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:40.847482 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5b56501f-1790-4bfb-9d7d-409ac5486391 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.224365 Jul 28 06:40:40.848371 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 288/584] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:40 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:41.110752 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c3eb6d6f-3c24-44f5-9d8b-eefbb644f23b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:41.111352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c3eb6d6f-3c24-44f5-9d8b-eefbb644f23b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:41.120439 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c3eb6d6f-3c24-44f5-9d8b-eefbb644f23b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.120885 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c3eb6d6f-3c24-44f5-9d8b-eefbb644f23b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.121857 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c3eb6d6f-3c24-44f5-9d8b-eefbb644f23b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.122354 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c3eb6d6f-3c24-44f5-9d8b-eefbb644f23b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.250543 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c3eb6d6f-3c24-44f5-9d8b-eefbb644f23b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:41.257936 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c3eb6d6f-3c24-44f5-9d8b-eefbb644f23b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.151604 Jul 28 06:40:41.258503 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 297/585] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:41 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:41.410721 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6b8ceb84-f689-40f2-bdd0-4c41a6ffce48 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:41.411258 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6b8ceb84-f689-40f2-bdd0-4c41a6ffce48 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:41.417831 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6b8ceb84-f689-40f2-bdd0-4c41a6ffce48 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.418200 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6b8ceb84-f689-40f2-bdd0-4c41a6ffce48 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.418988 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6b8ceb84-f689-40f2-bdd0-4c41a6ffce48 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.419428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6b8ceb84-f689-40f2-bdd0-4c41a6ffce48 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.734047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b503921e-794a-4cd4-8647-6aba9221e7ad tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:41.734682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b503921e-794a-4cd4-8647-6aba9221e7ad tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:41.741561 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b503921e-794a-4cd4-8647-6aba9221e7ad tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.742007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b503921e-794a-4cd4-8647-6aba9221e7ad tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.742762 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b503921e-794a-4cd4-8647-6aba9221e7ad tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.743189 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b503921e-794a-4cd4-8647-6aba9221e7ad tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.747274 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:41.784373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6b8ceb84-f689-40f2-bdd0-4c41a6ffce48 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:41.792708 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6b8ceb84-f689-40f2-bdd0-4c41a6ffce48 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:41.794330 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6b8ceb84-f689-40f2-bdd0-4c41a6ffce48 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:41.795576 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6b8ceb84-f689-40f2-bdd0-4c41a6ffce48 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.389479 Jul 28 06:40:41.796238 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 289/586] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:41 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:41.869589 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-72972bbf-78c3-46ce-9ff5-1b51b95a195b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:41.870292 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-72972bbf-78c3-46ce-9ff5-1b51b95a195b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:41.872913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b503921e-794a-4cd4-8647-6aba9221e7ad tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:41.876505 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-72972bbf-78c3-46ce-9ff5-1b51b95a195b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.877058 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-72972bbf-78c3-46ce-9ff5-1b51b95a195b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.877959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-72972bbf-78c3-46ce-9ff5-1b51b95a195b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.878400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-72972bbf-78c3-46ce-9ff5-1b51b95a195b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.881418 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b503921e-794a-4cd4-8647-6aba9221e7ad tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.151143 Jul 28 06:40:41.881983 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 298/587] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:41 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:42.007462 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-72972bbf-78c3-46ce-9ff5-1b51b95a195b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:42.014878 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-72972bbf-78c3-46ce-9ff5-1b51b95a195b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.149237 Jul 28 06:40:42.015426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 290/588] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:41 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:42.279583 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6b618558-8937-4046-95e8-9ee6fffd6383 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:42.280112 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6b618558-8937-4046-95e8-9ee6fffd6383 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:42.286797 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6b618558-8937-4046-95e8-9ee6fffd6383 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:42.287248 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6b618558-8937-4046-95e8-9ee6fffd6383 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:42.288016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6b618558-8937-4046-95e8-9ee6fffd6383 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:42.288450 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6b618558-8937-4046-95e8-9ee6fffd6383 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:42.421977 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6b618558-8937-4046-95e8-9ee6fffd6383 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:42.429694 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6b618558-8937-4046-95e8-9ee6fffd6383 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.154079 Jul 28 06:40:42.430254 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 299/589] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:42 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:42.819716 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8f5fc4e1-70ce-40b6-a05e-334d18deecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:42.820334 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8f5fc4e1-70ce-40b6-a05e-334d18deecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:42.826867 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8f5fc4e1-70ce-40b6-a05e-334d18deecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:42.827320 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8f5fc4e1-70ce-40b6-a05e-334d18deecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:42.828078 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8f5fc4e1-70ce-40b6-a05e-334d18deecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:42.828519 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8f5fc4e1-70ce-40b6-a05e-334d18deecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:42.902718 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9f1e9de4-de28-4892-95e1-81fb806d515f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:42.903325 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9f1e9de4-de28-4892-95e1-81fb806d515f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:42.910288 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f1e9de4-de28-4892-95e1-81fb806d515f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:42.910731 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f1e9de4-de28-4892-95e1-81fb806d515f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:42.911489 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f1e9de4-de28-4892-95e1-81fb806d515f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:42.911915 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f1e9de4-de28-4892-95e1-81fb806d515f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:42.961860 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8f5fc4e1-70ce-40b6-a05e-334d18deecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:42.970699 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8f5fc4e1-70ce-40b6-a05e-334d18deecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:42.972256 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8f5fc4e1-70ce-40b6-a05e-334d18deecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:42.973493 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8f5fc4e1-70ce-40b6-a05e-334d18deecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.157937 Jul 28 06:40:42.974055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 291/590] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:42 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:43.035980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9d99d3d4-59dc-4e3e-9092-dbd2ec850678 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:43.036589 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9d99d3d4-59dc-4e3e-9092-dbd2ec850678 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:43.042538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9d99d3d4-59dc-4e3e-9092-dbd2ec850678 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:43.042988 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9d99d3d4-59dc-4e3e-9092-dbd2ec850678 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:43.043757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9d99d3d4-59dc-4e3e-9092-dbd2ec850678 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:43.044193 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9d99d3d4-59dc-4e3e-9092-dbd2ec850678 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:43.045362 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9f1e9de4-de28-4892-95e1-81fb806d515f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:43.052776 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9f1e9de4-de28-4892-95e1-81fb806d515f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1358 microversion: 2.1 time: 0.154031 Jul 28 06:40:43.053367 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 300/591] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:42 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:43.172163 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9d99d3d4-59dc-4e3e-9092-dbd2ec850678 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:43.179669 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9d99d3d4-59dc-4e3e-9092-dbd2ec850678 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.148166 Jul 28 06:40:43.180235 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 292/592] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:43 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:43.451258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e9c33a96-37af-4962-8934-637ed3068b14 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:43.451870 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e9c33a96-37af-4962-8934-637ed3068b14 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:43.459126 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e9c33a96-37af-4962-8934-637ed3068b14 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:43.459571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e9c33a96-37af-4962-8934-637ed3068b14 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:43.460330 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e9c33a96-37af-4962-8934-637ed3068b14 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:43.460763 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e9c33a96-37af-4962-8934-637ed3068b14 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:43.619928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e9c33a96-37af-4962-8934-637ed3068b14 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:43.629895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e9c33a96-37af-4962-8934-637ed3068b14 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.182374 Jul 28 06:40:43.642384 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 301/593] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:43 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:43.997557 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8005056a-589d-4d1f-ae2b-b589e41aeffd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:43.998172 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8005056a-589d-4d1f-ae2b-b589e41aeffd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:44.012283 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8005056a-589d-4d1f-ae2b-b589e41aeffd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.012283 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8005056a-589d-4d1f-ae2b-b589e41aeffd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.015107 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8005056a-589d-4d1f-ae2b-b589e41aeffd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.015728 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8005056a-589d-4d1f-ae2b-b589e41aeffd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.074906 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a3b15313-f3cb-4478-ba4d-e91f996e90e0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:44.075661 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a3b15313-f3cb-4478-ba4d-e91f996e90e0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:44.087783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3b15313-f3cb-4478-ba4d-e91f996e90e0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.088246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3b15313-f3cb-4478-ba4d-e91f996e90e0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.089025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3b15313-f3cb-4478-ba4d-e91f996e90e0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.089501 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3b15313-f3cb-4478-ba4d-e91f996e90e0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.227847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8005056a-589d-4d1f-ae2b-b589e41aeffd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:44.234165 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:44.254048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a3b15313-f3cb-4478-ba4d-e91f996e90e0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:44.255300 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8005056a-589d-4d1f-ae2b-b589e41aeffd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:44.257273 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8005056a-589d-4d1f-ae2b-b589e41aeffd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:44.258857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8005056a-589d-4d1f-ae2b-b589e41aeffd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.266305 Jul 28 06:40:44.273584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 293/594] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:43 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:44.273695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a3b15313-f3cb-4478-ba4d-e91f996e90e0 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1548 microversion: 2.1 time: 0.192156 Jul 28 06:40:44.273695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 302/595] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:44 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1548 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:44.279067 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0ccca4be-872d-4245-b99a-dfd8b06d0654 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:44.281383 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0ccca4be-872d-4245-b99a-dfd8b06d0654 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:44.288202 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2f30bc58-23e6-4588-8bbc-7de0e2dc2b97 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:44.289507 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2f30bc58-23e6-4588-8bbc-7de0e2dc2b97 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:44.290466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0ccca4be-872d-4245-b99a-dfd8b06d0654 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.290867 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0ccca4be-872d-4245-b99a-dfd8b06d0654 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.291708 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0ccca4be-872d-4245-b99a-dfd8b06d0654 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.292156 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0ccca4be-872d-4245-b99a-dfd8b06d0654 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.296498 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2f30bc58-23e6-4588-8bbc-7de0e2dc2b97 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.297052 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2f30bc58-23e6-4588-8bbc-7de0e2dc2b97 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.298188 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2f30bc58-23e6-4588-8bbc-7de0e2dc2b97 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.298744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2f30bc58-23e6-4588-8bbc-7de0e2dc2b97 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.520981 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2f30bc58-23e6-4588-8bbc-7de0e2dc2b97 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:44.529658 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2f30bc58-23e6-4588-8bbc-7de0e2dc2b97 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1548 microversion: 2.1 time: 0.246363 Jul 28 06:40:44.535152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0ccca4be-872d-4245-b99a-dfd8b06d0654 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:44.546032 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 303/596] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:44 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1548 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:44.546716 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0ccca4be-872d-4245-b99a-dfd8b06d0654 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.282507 Jul 28 06:40:44.549746 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 294/597] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:44 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:44.552408 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f4663d44-014c-420a-9292-c1a49fc85c03 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:44.557847 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f4663d44-014c-420a-9292-c1a49fc85c03 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:44.558605 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f4663d44-014c-420a-9292-c1a49fc85c03 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Searching by: {'deleted': False, 'project_id': '6b7e4c91aaaf48e2b134128055919a47'} {{(pid=124562) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 06:40:44.566109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4663d44-014c-420a-9292-c1a49fc85c03 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.566570 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4663d44-014c-420a-9292-c1a49fc85c03 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.567362 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4663d44-014c-420a-9292-c1a49fc85c03 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.567792 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4663d44-014c-420a-9292-c1a49fc85c03 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.654443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6daa966d-ec3f-4433-926f-f4bda927a669 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:44.655084 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6daa966d-ec3f-4433-926f-f4bda927a669 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:44.666056 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6daa966d-ec3f-4433-926f-f4bda927a669 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.666877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6daa966d-ec3f-4433-926f-f4bda927a669 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.668072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6daa966d-ec3f-4433-926f-f4bda927a669 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.668836 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6daa966d-ec3f-4433-926f-f4bda927a669 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.673741 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.multi_cell_list [None req-f4663d44-014c-420a-9292-c1a49fc85c03 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 06:40:44.797908 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f4663d44-014c-420a-9292-c1a49fc85c03 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.250192 Jul 28 06:40:44.804613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 304/598] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Jul 28 06:40:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:40:44.809380 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-56cdc91f-40d1-445d-99dc-a932062395e5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:44.809991 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-56cdc91f-40d1-445d-99dc-a932062395e5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:44.816928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56cdc91f-40d1-445d-99dc-a932062395e5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.817447 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56cdc91f-40d1-445d-99dc-a932062395e5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.818471 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56cdc91f-40d1-445d-99dc-a932062395e5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.818896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56cdc91f-40d1-445d-99dc-a932062395e5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.892381 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6daa966d-ec3f-4433-926f-f4bda927a669 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:44.902058 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6daa966d-ec3f-4433-926f-f4bda927a669 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.253208 Jul 28 06:40:44.903267 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 295/599] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:44 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:45.038432 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-56cdc91f-40d1-445d-99dc-a932062395e5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:45.049468 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-56cdc91f-40d1-445d-99dc-a932062395e5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1548 microversion: 2.1 time: 0.243726 Jul 28 06:40:45.050246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 305/600] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:44 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1548 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:45.291948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2d94dda4-0cf6-4023-9746-7cb8526db5f3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:45.292873 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2d94dda4-0cf6-4023-9746-7cb8526db5f3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:45.301094 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d94dda4-0cf6-4023-9746-7cb8526db5f3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:45.301567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d94dda4-0cf6-4023-9746-7cb8526db5f3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:45.302437 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d94dda4-0cf6-4023-9746-7cb8526db5f3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:45.303159 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d94dda4-0cf6-4023-9746-7cb8526db5f3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:45.537171 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d94dda4-0cf6-4023-9746-7cb8526db5f3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:45.547063 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d94dda4-0cf6-4023-9746-7cb8526db5f3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:45.550642 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d94dda4-0cf6-4023-9746-7cb8526db5f3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:45.552934 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2d94dda4-0cf6-4023-9746-7cb8526db5f3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.269521 Jul 28 06:40:45.553837 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 296/601] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:45 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:45.572403 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-16322eb2-c28e-42e9-988c-a1697c0f43af tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:45.573000 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-16322eb2-c28e-42e9-988c-a1697c0f43af tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:45.585341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16322eb2-c28e-42e9-988c-a1697c0f43af tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:45.585341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16322eb2-c28e-42e9-988c-a1697c0f43af tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:45.585341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16322eb2-c28e-42e9-988c-a1697c0f43af tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:45.585341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16322eb2-c28e-42e9-988c-a1697c0f43af tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:45.739913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-16322eb2-c28e-42e9-988c-a1697c0f43af tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:45.749791 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-16322eb2-c28e-42e9-988c-a1697c0f43af tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.181484 Jul 28 06:40:45.760615 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 306/602] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:45 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:45.923509 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3d318240-4b29-4110-b4a2-27a1d01e85dd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:45.924224 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3d318240-4b29-4110-b4a2-27a1d01e85dd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:45.930288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3d318240-4b29-4110-b4a2-27a1d01e85dd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:45.930740 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3d318240-4b29-4110-b4a2-27a1d01e85dd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:45.931501 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3d318240-4b29-4110-b4a2-27a1d01e85dd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:45.931940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3d318240-4b29-4110-b4a2-27a1d01e85dd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:46.063325 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3d318240-4b29-4110-b4a2-27a1d01e85dd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:46.071146 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3d318240-4b29-4110-b4a2-27a1d01e85dd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.151640 Jul 28 06:40:46.071708 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 297/603] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:45 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:46.579406 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9864ef8d-78fe-4148-94ec-7aaff8f45094 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:46.580017 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9864ef8d-78fe-4148-94ec-7aaff8f45094 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:46.586112 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9864ef8d-78fe-4148-94ec-7aaff8f45094 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:46.586561 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9864ef8d-78fe-4148-94ec-7aaff8f45094 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:46.587350 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9864ef8d-78fe-4148-94ec-7aaff8f45094 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:46.587786 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9864ef8d-78fe-4148-94ec-7aaff8f45094 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:46.720994 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9864ef8d-78fe-4148-94ec-7aaff8f45094 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:46.728952 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9864ef8d-78fe-4148-94ec-7aaff8f45094 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:46.730510 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9864ef8d-78fe-4148-94ec-7aaff8f45094 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:46.731669 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9864ef8d-78fe-4148-94ec-7aaff8f45094 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.156722 Jul 28 06:40:46.732227 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 307/604] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:46 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:46.771096 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-829f2a7d-82d9-4316-82d0-681824e3664e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:46.771707 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-829f2a7d-82d9-4316-82d0-681824e3664e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:46.778174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-829f2a7d-82d9-4316-82d0-681824e3664e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:46.778623 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-829f2a7d-82d9-4316-82d0-681824e3664e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:46.779383 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-829f2a7d-82d9-4316-82d0-681824e3664e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:46.779821 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-829f2a7d-82d9-4316-82d0-681824e3664e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:46.910419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-829f2a7d-82d9-4316-82d0-681824e3664e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:46.917878 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-829f2a7d-82d9-4316-82d0-681824e3664e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.150651 Jul 28 06:40:46.918446 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 298/605] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:46 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:47.091947 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-40af3782-57a9-4034-aa4c-c0afc65fc8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:47.092561 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-40af3782-57a9-4034-aa4c-c0afc65fc8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:47.098705 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-40af3782-57a9-4034-aa4c-c0afc65fc8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:47.099151 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-40af3782-57a9-4034-aa4c-c0afc65fc8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:47.099912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-40af3782-57a9-4034-aa4c-c0afc65fc8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:47.100350 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-40af3782-57a9-4034-aa4c-c0afc65fc8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:47.236946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-40af3782-57a9-4034-aa4c-c0afc65fc8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:47.244304 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-40af3782-57a9-4034-aa4c-c0afc65fc8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.156247 Jul 28 06:40:47.244872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 308/606] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:47 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:47.754024 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-26d8e22c-d606-4182-bddb-161a63298c05 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:47.754674 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-26d8e22c-d606-4182-bddb-161a63298c05 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:47.760601 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26d8e22c-d606-4182-bddb-161a63298c05 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:47.761048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26d8e22c-d606-4182-bddb-161a63298c05 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:47.761906 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26d8e22c-d606-4182-bddb-161a63298c05 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:47.762342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26d8e22c-d606-4182-bddb-161a63298c05 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:47.890796 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-26d8e22c-d606-4182-bddb-161a63298c05 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:47.899456 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-26d8e22c-d606-4182-bddb-161a63298c05 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:47.900950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-26d8e22c-d606-4182-bddb-161a63298c05 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:47.902118 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-26d8e22c-d606-4182-bddb-161a63298c05 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.152195 Jul 28 06:40:47.902707 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 299/607] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:47 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:47.939460 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9b9c5a67-51ee-4600-af64-88e1c7ef0fb0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:47.940041 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9b9c5a67-51ee-4600-af64-88e1c7ef0fb0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:47.946308 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9b9c5a67-51ee-4600-af64-88e1c7ef0fb0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:47.946753 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9b9c5a67-51ee-4600-af64-88e1c7ef0fb0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:47.947511 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9b9c5a67-51ee-4600-af64-88e1c7ef0fb0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:47.947949 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9b9c5a67-51ee-4600-af64-88e1c7ef0fb0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:48.097002 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9b9c5a67-51ee-4600-af64-88e1c7ef0fb0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:48.115183 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9b9c5a67-51ee-4600-af64-88e1c7ef0fb0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.179858 Jul 28 06:40:48.115823 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 309/608] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:47 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:48.266777 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c34ed8a7-80f0-4adc-ba94-4d204650b987 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:48.267402 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c34ed8a7-80f0-4adc-ba94-4d204650b987 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:48.274141 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c34ed8a7-80f0-4adc-ba94-4d204650b987 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:48.274597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c34ed8a7-80f0-4adc-ba94-4d204650b987 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:48.309741 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c34ed8a7-80f0-4adc-ba94-4d204650b987 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:48.310644 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c34ed8a7-80f0-4adc-ba94-4d204650b987 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:48.541128 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c34ed8a7-80f0-4adc-ba94-4d204650b987 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:48.549229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c34ed8a7-80f0-4adc-ba94-4d204650b987 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.286840 Jul 28 06:40:48.550375 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 300/609] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:48 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:48.788633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-40ae47ea-c2e9-4ef5-8e50-ec0423241918 req-452c6d62-7ede-454b-9604-0e0bf55b77ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7df248c-2b87-417e-b113-ecce4d8c0840", "name": "network-vif-plugged", "status": "completed", "tag": "e2fc8e5d-c2ef-4ebe-97f9-f660cc1fec0a"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:48.811012 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-40ae47ea-c2e9-4ef5-8e50-ec0423241918 req-452c6d62-7ede-454b-9604-0e0bf55b77ff service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:48.812027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-40ae47ea-c2e9-4ef5-8e50-ec0423241918 req-452c6d62-7ede-454b-9604-0e0bf55b77ff service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:48.827359 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-40ae47ea-c2e9-4ef5-8e50-ec0423241918 req-452c6d62-7ede-454b-9604-0e0bf55b77ff service nova] Creating event network-vif-plugged:e2fc8e5d-c2ef-4ebe-97f9-f660cc1fec0a for instance b7df248c-2b87-417e-b113-ecce4d8c0840 on hv-cinder-85060 Jul 28 06:40:48.834052 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-40ae47ea-c2e9-4ef5-8e50-ec0423241918 req-452c6d62-7ede-454b-9604-0e0bf55b77ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050933 Jul 28 06:40:48.835461 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 310/610] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:40:48.928342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a1638698-ed6e-4176-8eb4-d4c62746d510 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:48.929083 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a1638698-ed6e-4176-8eb4-d4c62746d510 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:48.948015 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a1638698-ed6e-4176-8eb4-d4c62746d510 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:48.948607 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a1638698-ed6e-4176-8eb4-d4c62746d510 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:48.954455 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a1638698-ed6e-4176-8eb4-d4c62746d510 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:48.955103 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a1638698-ed6e-4176-8eb4-d4c62746d510 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:49.083235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a70740c4-aee6-462a-8c0e-1936b2007da4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ca8756a-b9c1-46fc-b64d-2e32816dfa30"}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:49.085726 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a70740c4-aee6-462a-8c0e-1936b2007da4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:49.092233 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a70740c4-aee6-462a-8c0e-1936b2007da4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:49.092688 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a70740c4-aee6-462a-8c0e-1936b2007da4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:49.093502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a70740c4-aee6-462a-8c0e-1936b2007da4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:49.093942 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a70740c4-aee6-462a-8c0e-1936b2007da4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:49.158650 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a1638698-ed6e-4176-8eb4-d4c62746d510 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:49.171203 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a1638698-ed6e-4176-8eb4-d4c62746d510 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:49.173998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a1638698-ed6e-4176-8eb4-d4c62746d510 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:49.175139 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a1638698-ed6e-4176-8eb4-d4c62746d510 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.252893 Jul 28 06:40:49.176298 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 301/611] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:48 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:49.181822 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e3e3533d-d43a-449e-825a-042f02dceebd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:49.183275 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e3e3533d-d43a-449e-825a-042f02dceebd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:49.190566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e3e3533d-d43a-449e-825a-042f02dceebd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:49.191735 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e3e3533d-d43a-449e-825a-042f02dceebd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:49.194182 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e3e3533d-d43a-449e-825a-042f02dceebd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:49.194697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e3e3533d-d43a-449e-825a-042f02dceebd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:49.334750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e3e3533d-d43a-449e-825a-042f02dceebd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:49.343905 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e3e3533d-d43a-449e-825a-042f02dceebd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.166099 Jul 28 06:40:49.345460 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 302/612] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:49 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:49.571876 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2d85009c-c71e-4c41-94f5-18705d02591e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:49.572407 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2d85009c-c71e-4c41-94f5-18705d02591e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:49.579731 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d85009c-c71e-4c41-94f5-18705d02591e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:49.580187 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d85009c-c71e-4c41-94f5-18705d02591e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:49.581197 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d85009c-c71e-4c41-94f5-18705d02591e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:49.581827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d85009c-c71e-4c41-94f5-18705d02591e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:49.738222 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d85009c-c71e-4c41-94f5-18705d02591e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:49.746843 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2d85009c-c71e-4c41-94f5-18705d02591e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.179268 Jul 28 06:40:49.747626 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 303/613] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:49 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:50.202693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d93d4b74-a865-4e9d-a164-8e9c54aa6ef7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:50.203482 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d93d4b74-a865-4e9d-a164-8e9c54aa6ef7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:50.206234 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:50.211771 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d93d4b74-a865-4e9d-a164-8e9c54aa6ef7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:50.212250 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d93d4b74-a865-4e9d-a164-8e9c54aa6ef7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:50.213047 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d93d4b74-a865-4e9d-a164-8e9c54aa6ef7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:50.213518 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d93d4b74-a865-4e9d-a164-8e9c54aa6ef7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:50.363138 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d93d4b74-a865-4e9d-a164-8e9c54aa6ef7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:50.371427 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d93d4b74-a865-4e9d-a164-8e9c54aa6ef7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:50.372956 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d93d4b74-a865-4e9d-a164-8e9c54aa6ef7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:50.374139 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d93d4b74-a865-4e9d-a164-8e9c54aa6ef7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1720 microversion: 2.20 time: 0.175422 Jul 28 06:40:50.374703 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 304/614] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:50 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:50.379495 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-35dbaa8d-7182-4852-bd3b-88ad48e88899 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:50.380090 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-35dbaa8d-7182-4852-bd3b-88ad48e88899 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:50.385895 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-35dbaa8d-7182-4852-bd3b-88ad48e88899 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:50.386552 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-35dbaa8d-7182-4852-bd3b-88ad48e88899 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:50.387494 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-35dbaa8d-7182-4852-bd3b-88ad48e88899 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:50.387934 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-35dbaa8d-7182-4852-bd3b-88ad48e88899 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:50.536196 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-35dbaa8d-7182-4852-bd3b-88ad48e88899 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:50.544699 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-35dbaa8d-7182-4852-bd3b-88ad48e88899 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.169034 Jul 28 06:40:50.549703 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 305/615] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:50 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:50.769470 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3cca8a85-5097-43a6-964b-dac320bc0d2e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:50.770194 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3cca8a85-5097-43a6-964b-dac320bc0d2e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:50.776544 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3cca8a85-5097-43a6-964b-dac320bc0d2e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:50.777127 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3cca8a85-5097-43a6-964b-dac320bc0d2e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:50.777993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3cca8a85-5097-43a6-964b-dac320bc0d2e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:50.778502 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3cca8a85-5097-43a6-964b-dac320bc0d2e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:50.978160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3cca8a85-5097-43a6-964b-dac320bc0d2e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:50.988373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3cca8a85-5097-43a6-964b-dac320bc0d2e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.223541 Jul 28 06:40:51.007786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 306/616] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:50 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:51.258640 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a70740c4-aee6-462a-8c0e-1936b2007da4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "POST /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.180246 Jul 28 06:40:51.259715 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 311/617] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:40:49 2022] POST /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments => generated 194 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:40:51.399078 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-bce8f50c-0147-4364-9912-bfe56e750855 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:51.399913 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-bce8f50c-0147-4364-9912-bfe56e750855 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:51.407949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bce8f50c-0147-4364-9912-bfe56e750855 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:51.408520 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bce8f50c-0147-4364-9912-bfe56e750855 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:51.409498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bce8f50c-0147-4364-9912-bfe56e750855 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:51.409971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bce8f50c-0147-4364-9912-bfe56e750855 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:51.552264 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-bce8f50c-0147-4364-9912-bfe56e750855 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:51.560531 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-bce8f50c-0147-4364-9912-bfe56e750855 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:51.562193 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-bce8f50c-0147-4364-9912-bfe56e750855 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:51.563624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-bce8f50c-0147-4364-9912-bfe56e750855 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1723 microversion: 2.20 time: 0.168899 Jul 28 06:40:51.566684 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ab1d91c1-10d1-49f8-a69f-3c20068f3809 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:51.567420 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ab1d91c1-10d1-49f8-a69f-3c20068f3809 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:51.576803 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ab1d91c1-10d1-49f8-a69f-3c20068f3809 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:51.577653 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ab1d91c1-10d1-49f8-a69f-3c20068f3809 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:51.577925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 307/618] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:51 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:51.578538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ab1d91c1-10d1-49f8-a69f-3c20068f3809 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:51.579296 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ab1d91c1-10d1-49f8-a69f-3c20068f3809 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:51.587499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d3ec519a-58f9-46bb-879a-8f5052652d47 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1de70103-7362-4bf5-a603-8698e8bea7fa"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:51.590076 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d3ec519a-58f9-46bb-879a-8f5052652d47 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:51.596856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3ec519a-58f9-46bb-879a-8f5052652d47 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:51.597344 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3ec519a-58f9-46bb-879a-8f5052652d47 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:51.598202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3ec519a-58f9-46bb-879a-8f5052652d47 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:51.598722 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3ec519a-58f9-46bb-879a-8f5052652d47 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:51.781995 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ab1d91c1-10d1-49f8-a69f-3c20068f3809 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:51.793063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ab1d91c1-10d1-49f8-a69f-3c20068f3809 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.230550 Jul 28 06:40:51.794391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 312/619] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:51 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:51.861957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:52.001216 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d3ec519a-58f9-46bb-879a-8f5052652d47 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "POST /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.417204 Jul 28 06:40:52.007608 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 308/620] 10.222.0.20 () {62 vars in 1364 bytes} [Thu Jul 28 06:40:51 2022] POST /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments => generated 188 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:40:52.015037 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-443fd2ec-79cf-42f7-aa72-f75fdf43b63c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:52.015659 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-443fd2ec-79cf-42f7-aa72-f75fdf43b63c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:52.025649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-443fd2ec-79cf-42f7-aa72-f75fdf43b63c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.026347 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-443fd2ec-79cf-42f7-aa72-f75fdf43b63c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.027923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-443fd2ec-79cf-42f7-aa72-f75fdf43b63c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.030800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-443fd2ec-79cf-42f7-aa72-f75fdf43b63c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.185393 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6457651f-5ab2-443b-a83e-6b82c6562494 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:52.186374 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6457651f-5ab2-443b-a83e-6b82c6562494 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:52.194626 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6457651f-5ab2-443b-a83e-6b82c6562494 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.195143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6457651f-5ab2-443b-a83e-6b82c6562494 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.196178 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6457651f-5ab2-443b-a83e-6b82c6562494 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.196699 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6457651f-5ab2-443b-a83e-6b82c6562494 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.247697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6457651f-5ab2-443b-a83e-6b82c6562494 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124563) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 06:40:52.265117 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-443fd2ec-79cf-42f7-aa72-f75fdf43b63c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:52.269010 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:52.278290 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-443fd2ec-79cf-42f7-aa72-f75fdf43b63c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.266728 Jul 28 06:40:52.279192 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 313/621] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:52 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:52.352901 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6457651f-5ab2-443b-a83e-6b82c6562494 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "POST /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/action" status: 202 len: 0 microversion: 2.20 time: 0.171512 Jul 28 06:40:52.353789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 309/622] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Jul 28 06:40:52 2022] POST /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 06:40:52.355575 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b96fe6dc-e8d0-49f7-9b84-b130b73ce5fa tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:52.356155 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b96fe6dc-e8d0-49f7-9b84-b130b73ce5fa tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:52.364367 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b96fe6dc-e8d0-49f7-9b84-b130b73ce5fa tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.365182 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b96fe6dc-e8d0-49f7-9b84-b130b73ce5fa tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.366253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b96fe6dc-e8d0-49f7-9b84-b130b73ce5fa tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.366895 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-00e1ee39-6a7c-486f-b349-0a0db56be5ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:52.367378 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b96fe6dc-e8d0-49f7-9b84-b130b73ce5fa tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.368849 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-00e1ee39-6a7c-486f-b349-0a0db56be5ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:52.379667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-00e1ee39-6a7c-486f-b349-0a0db56be5ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.383380 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-00e1ee39-6a7c-486f-b349-0a0db56be5ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.385383 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-00e1ee39-6a7c-486f-b349-0a0db56be5ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.386658 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-00e1ee39-6a7c-486f-b349-0a0db56be5ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.565642 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-b96fe6dc-e8d0-49f7-9b84-b130b73ce5fa tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lazy-loading 'services' on Instance uuid 4d88edfe-4077-4ab9-a0aa-4225d54024a7 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:40:52.605328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-00e1ee39-6a7c-486f-b349-0a0db56be5ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:52.615328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-00e1ee39-6a7c-486f-b349-0a0db56be5ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:52.617156 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-00e1ee39-6a7c-486f-b349-0a0db56be5ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:52.618709 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-00e1ee39-6a7c-486f-b349-0a0db56be5ff tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1809 microversion: 2.20 time: 0.259016 Jul 28 06:40:52.619728 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 310/623] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:52 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:40:52.739585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b96fe6dc-e8d0-49f7-9b84-b130b73ce5fa tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7/os-volume_attachments/8c5e28d9-218d-42ee-bf45-5930d2312788" status: 202 len: 0 microversion: 2.1 time: 0.390355 Jul 28 06:40:52.746049 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 314/624] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:40:52 2022] DELETE /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7/os-volume_attachments/8c5e28d9-218d-42ee-bf45-5930d2312788 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:40:52.816912 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7d9066bb-d0a5-461d-9951-2adb6300d754 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:52.818328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7d9066bb-d0a5-461d-9951-2adb6300d754 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:52.828258 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7d9066bb-d0a5-461d-9951-2adb6300d754 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.829486 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7d9066bb-d0a5-461d-9951-2adb6300d754 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.838338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7d9066bb-d0a5-461d-9951-2adb6300d754 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.843576 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7d9066bb-d0a5-461d-9951-2adb6300d754 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:53.140228 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7d9066bb-d0a5-461d-9951-2adb6300d754 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:53.148538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7d9066bb-d0a5-461d-9951-2adb6300d754 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.336052 Jul 28 06:40:53.149110 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 311/625] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:52 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:53.302998 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c8cf0d13-ab2e-49ae-9474-8536ef5c839f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:53.304332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c8cf0d13-ab2e-49ae-9474-8536ef5c839f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:53.310571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c8cf0d13-ab2e-49ae-9474-8536ef5c839f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:53.311018 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c8cf0d13-ab2e-49ae-9474-8536ef5c839f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:53.312059 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c8cf0d13-ab2e-49ae-9474-8536ef5c839f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:53.312798 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c8cf0d13-ab2e-49ae-9474-8536ef5c839f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:53.475224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c8cf0d13-ab2e-49ae-9474-8536ef5c839f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:53.482756 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c8cf0d13-ab2e-49ae-9474-8536ef5c839f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.185023 Jul 28 06:40:53.483286 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 315/626] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:53 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:53.646961 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c74d250c-9210-455f-85c1-84cabecb6328 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:53.647571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c74d250c-9210-455f-85c1-84cabecb6328 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:53.654032 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c74d250c-9210-455f-85c1-84cabecb6328 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:53.654484 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c74d250c-9210-455f-85c1-84cabecb6328 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:53.655250 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c74d250c-9210-455f-85c1-84cabecb6328 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:53.655687 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c74d250c-9210-455f-85c1-84cabecb6328 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:53.794651 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c74d250c-9210-455f-85c1-84cabecb6328 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:53.804991 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c74d250c-9210-455f-85c1-84cabecb6328 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:53.806540 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c74d250c-9210-455f-85c1-84cabecb6328 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:53.807776 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c74d250c-9210-455f-85c1-84cabecb6328 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1809 microversion: 2.20 time: 0.164809 Jul 28 06:40:53.808332 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 312/627] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:53 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:54.183126 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-44afd573-202a-4d2b-8ace-a1ee42102b39 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:54.183738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-44afd573-202a-4d2b-8ace-a1ee42102b39 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:54.190505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-44afd573-202a-4d2b-8ace-a1ee42102b39 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:54.190951 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-44afd573-202a-4d2b-8ace-a1ee42102b39 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:54.191724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-44afd573-202a-4d2b-8ace-a1ee42102b39 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:54.192235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-44afd573-202a-4d2b-8ace-a1ee42102b39 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:54.355958 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-44afd573-202a-4d2b-8ace-a1ee42102b39 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:54.365323 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-44afd573-202a-4d2b-8ace-a1ee42102b39 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1367 microversion: 2.1 time: 0.185947 Jul 28 06:40:54.366322 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 316/628] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:54 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:54.506928 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-58cef2bc-3308-490a-8e26-a66db9399bc5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:54.507546 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-58cef2bc-3308-490a-8e26-a66db9399bc5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:54.518852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58cef2bc-3308-490a-8e26-a66db9399bc5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:54.519409 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58cef2bc-3308-490a-8e26-a66db9399bc5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:54.522735 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58cef2bc-3308-490a-8e26-a66db9399bc5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:54.523469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58cef2bc-3308-490a-8e26-a66db9399bc5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:54.683456 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-58cef2bc-3308-490a-8e26-a66db9399bc5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:54.692326 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-58cef2bc-3308-490a-8e26-a66db9399bc5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.189134 Jul 28 06:40:54.693713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 313/629] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:54 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:54.832637 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-80bb60d5-199c-48ec-88e8-0cc105e9428a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:54.833422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-80bb60d5-199c-48ec-88e8-0cc105e9428a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:54.835482 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:54.845062 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-80bb60d5-199c-48ec-88e8-0cc105e9428a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:54.845702 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-80bb60d5-199c-48ec-88e8-0cc105e9428a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:54.846487 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-80bb60d5-199c-48ec-88e8-0cc105e9428a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:54.846992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-80bb60d5-199c-48ec-88e8-0cc105e9428a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:54.986990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-80bb60d5-199c-48ec-88e8-0cc105e9428a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:55.002290 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-80bb60d5-199c-48ec-88e8-0cc105e9428a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:55.004828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-80bb60d5-199c-48ec-88e8-0cc105e9428a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:55.006555 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-80bb60d5-199c-48ec-88e8-0cc105e9428a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.179182 Jul 28 06:40:55.018474 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 317/630] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:54 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:55.386528 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e9f75b21-3b91-458e-a549-98630e70e32e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:55.387141 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e9f75b21-3b91-458e-a549-98630e70e32e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:55.393208 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e9f75b21-3b91-458e-a549-98630e70e32e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:55.393694 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e9f75b21-3b91-458e-a549-98630e70e32e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:55.394454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e9f75b21-3b91-458e-a549-98630e70e32e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:55.394894 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e9f75b21-3b91-458e-a549-98630e70e32e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:55.537744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e9f75b21-3b91-458e-a549-98630e70e32e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:55.546437 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e9f75b21-3b91-458e-a549-98630e70e32e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1557 microversion: 2.1 time: 0.163687 Jul 28 06:40:55.547637 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 314/631] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:55 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:55.567437 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7a6742ec-ff98-475d-9493-27f03a2971e8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:55.568245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7a6742ec-ff98-475d-9493-27f03a2971e8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:55.574910 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a6742ec-ff98-475d-9493-27f03a2971e8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:55.575353 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a6742ec-ff98-475d-9493-27f03a2971e8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:55.576109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a6742ec-ff98-475d-9493-27f03a2971e8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:55.576541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a6742ec-ff98-475d-9493-27f03a2971e8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:55.706486 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7a6742ec-ff98-475d-9493-27f03a2971e8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142954 Jul 28 06:40:55.707078 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 318/632] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Jul 28 06:40:55 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:40:55.726819 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-475e11aa-2354-4fd8-8a34-97e6fef9afcd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:55.728183 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-475e11aa-2354-4fd8-8a34-97e6fef9afcd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:55.736234 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-475e11aa-2354-4fd8-8a34-97e6fef9afcd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:55.737075 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-475e11aa-2354-4fd8-8a34-97e6fef9afcd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:55.738053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-475e11aa-2354-4fd8-8a34-97e6fef9afcd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:55.738764 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-475e11aa-2354-4fd8-8a34-97e6fef9afcd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:55.971421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-475e11aa-2354-4fd8-8a34-97e6fef9afcd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:55.980578 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-475e11aa-2354-4fd8-8a34-97e6fef9afcd tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.258167 Jul 28 06:40:55.993316 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 315/633] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:55 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:56.033543 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b95b84ce-dbd2-40ce-a793-1dc2c1ade719 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:56.034568 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b95b84ce-dbd2-40ce-a793-1dc2c1ade719 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:56.061236 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b95b84ce-dbd2-40ce-a793-1dc2c1ade719 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:56.061735 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b95b84ce-dbd2-40ce-a793-1dc2c1ade719 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:56.066243 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b95b84ce-dbd2-40ce-a793-1dc2c1ade719 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:56.068520 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b95b84ce-dbd2-40ce-a793-1dc2c1ade719 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:56.318666 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b95b84ce-dbd2-40ce-a793-1dc2c1ade719 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:56.329443 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b95b84ce-dbd2-40ce-a793-1dc2c1ade719 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:56.331125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b95b84ce-dbd2-40ce-a793-1dc2c1ade719 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:56.332416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b95b84ce-dbd2-40ce-a793-1dc2c1ade719 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.304283 Jul 28 06:40:56.333088 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 319/634] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:56 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:57.003521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-26091f9a-6f72-4216-bde7-31f7584d4252 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:57.004238 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-26091f9a-6f72-4216-bde7-31f7584d4252 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:57.015295 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26091f9a-6f72-4216-bde7-31f7584d4252 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:57.016566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26091f9a-6f72-4216-bde7-31f7584d4252 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:57.022457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26091f9a-6f72-4216-bde7-31f7584d4252 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:57.023146 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26091f9a-6f72-4216-bde7-31f7584d4252 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:57.067705 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-f036c314-e2ed-4cd9-8193-86098473af24 req-7c0e1421-e597-4fb5-b62a-c06c587e515d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7df248c-2b87-417e-b113-ecce4d8c0840", "tag": "e2fc8e5d-c2ef-4ebe-97f9-f660cc1fec0a"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:57.079736 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-f036c314-e2ed-4cd9-8193-86098473af24 req-7c0e1421-e597-4fb5-b62a-c06c587e515d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:57.080437 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-f036c314-e2ed-4cd9-8193-86098473af24 req-7c0e1421-e597-4fb5-b62a-c06c587e515d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:57.092320 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-f036c314-e2ed-4cd9-8193-86098473af24 req-7c0e1421-e597-4fb5-b62a-c06c587e515d service nova] Creating event network-changed:e2fc8e5d-c2ef-4ebe-97f9-f660cc1fec0a for instance b7df248c-2b87-417e-b113-ecce4d8c0840 on hv-cinder-85060 Jul 28 06:40:57.098329 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-f036c314-e2ed-4cd9-8193-86098473af24 req-7c0e1421-e597-4fb5-b62a-c06c587e515d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035295 Jul 28 06:40:57.099482 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 320/635] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:40:57.184092 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-26091f9a-6f72-4216-bde7-31f7584d4252 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:57.198549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-26091f9a-6f72-4216-bde7-31f7584d4252 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.199330 Jul 28 06:40:57.213997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 316/636] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:56 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:57.263433 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-7c09be71-ef23-45db-a9e8-d0cc17e229cb req-804556a8-664c-48d0-82e5-849455a84cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a88fd0-386e-4cde-bddf-205dea943fc9", "name": "network-vif-plugged", "status": "completed", "tag": "fd589bac-7a7d-4978-bdbb-17282786c967"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:57.275723 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-7c09be71-ef23-45db-a9e8-d0cc17e229cb req-804556a8-664c-48d0-82e5-849455a84cdc service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:57.276455 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-7c09be71-ef23-45db-a9e8-d0cc17e229cb req-804556a8-664c-48d0-82e5-849455a84cdc service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:57.288851 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-7c09be71-ef23-45db-a9e8-d0cc17e229cb req-804556a8-664c-48d0-82e5-849455a84cdc service nova] Creating event network-vif-plugged:fd589bac-7a7d-4978-bdbb-17282786c967 for instance 65a88fd0-386e-4cde-bddf-205dea943fc9 on hv-cinder-85060 Jul 28 06:40:57.294661 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-7c09be71-ef23-45db-a9e8-d0cc17e229cb req-804556a8-664c-48d0-82e5-849455a84cdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035332 Jul 28 06:40:57.296042 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 321/637] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:40:57.356617 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-fa8144c3-a843-4523-9d99-cd30ddb6db6f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:57.358297 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-fa8144c3-a843-4523-9d99-cd30ddb6db6f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:57.370100 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa8144c3-a843-4523-9d99-cd30ddb6db6f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:57.370544 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa8144c3-a843-4523-9d99-cd30ddb6db6f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:57.372210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa8144c3-a843-4523-9d99-cd30ddb6db6f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:57.373014 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa8144c3-a843-4523-9d99-cd30ddb6db6f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:57.694833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-fa8144c3-a843-4523-9d99-cd30ddb6db6f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:57.705549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-fa8144c3-a843-4523-9d99-cd30ddb6db6f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:57.707271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-fa8144c3-a843-4523-9d99-cd30ddb6db6f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:57.708572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-fa8144c3-a843-4523-9d99-cd30ddb6db6f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.356526 Jul 28 06:40:57.709240 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 317/638] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:57 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:58.221324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6ed00163-83b7-4fa2-b618-310ca74dc4e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:58.222253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6ed00163-83b7-4fa2-b618-310ca74dc4e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:58.226260 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=94 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:58.231153 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6ed00163-83b7-4fa2-b618-310ca74dc4e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:58.232039 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6ed00163-83b7-4fa2-b618-310ca74dc4e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:58.233103 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6ed00163-83b7-4fa2-b618-310ca74dc4e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:58.233855 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6ed00163-83b7-4fa2-b618-310ca74dc4e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:58.440281 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6ed00163-83b7-4fa2-b618-310ca74dc4e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:58.449008 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6ed00163-83b7-4fa2-b618-310ca74dc4e5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.232424 Jul 28 06:40:58.449819 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 322/639] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:58 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:58.735900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-90426ff6-ebd6-4274-bb3b-659b33dfc0fa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:58.736496 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-90426ff6-ebd6-4274-bb3b-659b33dfc0fa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:58.742988 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90426ff6-ebd6-4274-bb3b-659b33dfc0fa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:58.743432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90426ff6-ebd6-4274-bb3b-659b33dfc0fa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:58.744179 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90426ff6-ebd6-4274-bb3b-659b33dfc0fa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:58.744644 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90426ff6-ebd6-4274-bb3b-659b33dfc0fa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:58.947883 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-90426ff6-ebd6-4274-bb3b-659b33dfc0fa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:58.956911 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-90426ff6-ebd6-4274-bb3b-659b33dfc0fa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:58.958461 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-90426ff6-ebd6-4274-bb3b-659b33dfc0fa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:58.959610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-90426ff6-ebd6-4274-bb3b-659b33dfc0fa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.227608 Jul 28 06:40:58.960167 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 318/640] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:58 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:40:59.471412 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a65ad6ff-87f2-42b8-8856-1c4476953e09 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:59.472024 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a65ad6ff-87f2-42b8-8856-1c4476953e09 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:59.478844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a65ad6ff-87f2-42b8-8856-1c4476953e09 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:59.479292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a65ad6ff-87f2-42b8-8856-1c4476953e09 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:59.480053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a65ad6ff-87f2-42b8-8856-1c4476953e09 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:59.480485 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a65ad6ff-87f2-42b8-8856-1c4476953e09 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:59.609236 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a65ad6ff-87f2-42b8-8856-1c4476953e09 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:59.616648 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a65ad6ff-87f2-42b8-8856-1c4476953e09 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1372 microversion: 2.1 time: 0.149741 Jul 28 06:40:59.617218 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 323/641] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:59 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:59.983199 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-23f4c7c7-7c74-441a-ad24-02ec2350e12f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:59.983811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-23f4c7c7-7c74-441a-ad24-02ec2350e12f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:59.990624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-23f4c7c7-7c74-441a-ad24-02ec2350e12f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:59.991071 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-23f4c7c7-7c74-441a-ad24-02ec2350e12f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:59.991836 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-23f4c7c7-7c74-441a-ad24-02ec2350e12f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:59.992270 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-23f4c7c7-7c74-441a-ad24-02ec2350e12f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:00.127188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-23f4c7c7-7c74-441a-ad24-02ec2350e12f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:00.136602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-23f4c7c7-7c74-441a-ad24-02ec2350e12f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:00.138148 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-23f4c7c7-7c74-441a-ad24-02ec2350e12f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:00.139624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-23f4c7c7-7c74-441a-ad24-02ec2350e12f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.160088 Jul 28 06:41:00.140263 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 319/642] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:40:59 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:00.638166 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b11f3579-e9cd-497d-9a51-3b002f80e8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:00.638733 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b11f3579-e9cd-497d-9a51-3b002f80e8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:00.645475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b11f3579-e9cd-497d-9a51-3b002f80e8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:00.646028 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b11f3579-e9cd-497d-9a51-3b002f80e8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:00.646799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b11f3579-e9cd-497d-9a51-3b002f80e8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:00.647236 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b11f3579-e9cd-497d-9a51-3b002f80e8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:00.779892 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b11f3579-e9cd-497d-9a51-3b002f80e8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:00.787863 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b11f3579-e9cd-497d-9a51-3b002f80e8da tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1566 microversion: 2.1 time: 0.153663 Jul 28 06:41:00.788427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 324/643] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:00 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:00.808498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5bcc1106-8855-4a89-9e66-73b812bc0763 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:00.808989 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5bcc1106-8855-4a89-9e66-73b812bc0763 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:00.815142 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5bcc1106-8855-4a89-9e66-73b812bc0763 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:00.815616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5bcc1106-8855-4a89-9e66-73b812bc0763 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:00.816370 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5bcc1106-8855-4a89-9e66-73b812bc0763 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:00.816799 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5bcc1106-8855-4a89-9e66-73b812bc0763 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:00.893707 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5bcc1106-8855-4a89-9e66-73b812bc0763 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089059 Jul 28 06:41:00.894318 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 320/644] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Jul 28 06:41:00 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:41:01.163931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3f12bef7-b43a-40e5-99f3-f9b1cc59b97a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:01.164454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3f12bef7-b43a-40e5-99f3-f9b1cc59b97a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:01.170798 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3f12bef7-b43a-40e5-99f3-f9b1cc59b97a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:01.171255 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3f12bef7-b43a-40e5-99f3-f9b1cc59b97a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:01.172628 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3f12bef7-b43a-40e5-99f3-f9b1cc59b97a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:01.173077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3f12bef7-b43a-40e5-99f3-f9b1cc59b97a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:01.317084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3f12bef7-b43a-40e5-99f3-f9b1cc59b97a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:01.326191 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3f12bef7-b43a-40e5-99f3-f9b1cc59b97a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:01.327708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3f12bef7-b43a-40e5-99f3-f9b1cc59b97a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:01.329475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3f12bef7-b43a-40e5-99f3-f9b1cc59b97a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.169356 Jul 28 06:41:01.330038 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 325/645] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:01 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:02.061244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-eec0c115-99e3-407d-b507-98a0ce9bf29b req-500706e8-39ce-43c3-8f5b-0c839565e5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a88fd0-386e-4cde-bddf-205dea943fc9", "tag": "fd589bac-7a7d-4978-bdbb-17282786c967"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:02.071842 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-eec0c115-99e3-407d-b507-98a0ce9bf29b req-500706e8-39ce-43c3-8f5b-0c839565e5c7 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:02.072288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-eec0c115-99e3-407d-b507-98a0ce9bf29b req-500706e8-39ce-43c3-8f5b-0c839565e5c7 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:02.084764 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-eec0c115-99e3-407d-b507-98a0ce9bf29b req-500706e8-39ce-43c3-8f5b-0c839565e5c7 service nova] Creating event network-changed:fd589bac-7a7d-4978-bdbb-17282786c967 for instance 65a88fd0-386e-4cde-bddf-205dea943fc9 on hv-cinder-85060 Jul 28 06:41:02.090078 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-eec0c115-99e3-407d-b507-98a0ce9bf29b req-500706e8-39ce-43c3-8f5b-0c839565e5c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032798 Jul 28 06:41:02.090771 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 321/646] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:41:02.353172 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-30cbc20b-e535-435b-bbcc-c83632e40c7c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:02.353828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-30cbc20b-e535-435b-bbcc-c83632e40c7c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:02.360899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-30cbc20b-e535-435b-bbcc-c83632e40c7c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:02.361453 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-30cbc20b-e535-435b-bbcc-c83632e40c7c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:02.362298 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-30cbc20b-e535-435b-bbcc-c83632e40c7c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:02.362808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-30cbc20b-e535-435b-bbcc-c83632e40c7c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:02.503865 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-30cbc20b-e535-435b-bbcc-c83632e40c7c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:02.514124 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-30cbc20b-e535-435b-bbcc-c83632e40c7c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:02.516170 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-30cbc20b-e535-435b-bbcc-c83632e40c7c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:02.517585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-30cbc20b-e535-435b-bbcc-c83632e40c7c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.168370 Jul 28 06:41:02.518152 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 326/647] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:02 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:03.201030 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c73f42e9-79a8-44ce-b24b-246639f0fadf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:03.201833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c73f42e9-79a8-44ce-b24b-246639f0fadf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:03.208102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c73f42e9-79a8-44ce-b24b-246639f0fadf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:03.208555 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c73f42e9-79a8-44ce-b24b-246639f0fadf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:03.209345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c73f42e9-79a8-44ce-b24b-246639f0fadf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:03.209787 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c73f42e9-79a8-44ce-b24b-246639f0fadf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:03.349038 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c73f42e9-79a8-44ce-b24b-246639f0fadf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:03.357266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c73f42e9-79a8-44ce-b24b-246639f0fadf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1594 microversion: 2.1 time: 0.161013 Jul 28 06:41:03.357879 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 322/648] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:03 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:03.542173 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-33a2a5aa-5b8f-44f3-adb8-5a139ace441c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:03.542778 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-33a2a5aa-5b8f-44f3-adb8-5a139ace441c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:03.550258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-33a2a5aa-5b8f-44f3-adb8-5a139ace441c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:03.550630 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-33a2a5aa-5b8f-44f3-adb8-5a139ace441c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:03.551399 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-33a2a5aa-5b8f-44f3-adb8-5a139ace441c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:03.551826 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-33a2a5aa-5b8f-44f3-adb8-5a139ace441c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:03.721542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-33a2a5aa-5b8f-44f3-adb8-5a139ace441c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:03.730051 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-33a2a5aa-5b8f-44f3-adb8-5a139ace441c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:03.731571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-33a2a5aa-5b8f-44f3-adb8-5a139ace441c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:03.732743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-33a2a5aa-5b8f-44f3-adb8-5a139ace441c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.194424 Jul 28 06:41:03.733324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 327/649] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:03 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:04.691922 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d3df8701-da0a-4109-96b8-8f3b9d19865c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:04.692489 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d3df8701-da0a-4109-96b8-8f3b9d19865c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:04.699448 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3df8701-da0a-4109-96b8-8f3b9d19865c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:04.699906 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3df8701-da0a-4109-96b8-8f3b9d19865c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:04.700674 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3df8701-da0a-4109-96b8-8f3b9d19865c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:04.701125 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3df8701-da0a-4109-96b8-8f3b9d19865c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:04.726955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d3df8701-da0a-4109-96b8-8f3b9d19865c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Going to try to terminate instance {{(pid=124563) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:41:04.754197 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SELECT=94 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:04.758453 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-54455130-afa9-443a-80b0-89f6fc230b51 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:04.759530 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-54455130-afa9-443a-80b0-89f6fc230b51 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:04.768009 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54455130-afa9-443a-80b0-89f6fc230b51 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:04.768876 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54455130-afa9-443a-80b0-89f6fc230b51 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:04.769819 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54455130-afa9-443a-80b0-89f6fc230b51 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:04.770332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54455130-afa9-443a-80b0-89f6fc230b51 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:04.829581 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d3df8701-da0a-4109-96b8-8f3b9d19865c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 204 len: 0 microversion: 2.1 time: 0.141461 Jul 28 06:41:04.830752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 323/650] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:41:04 2022] DELETE /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:41:04.842200 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4bd0dabf-814a-4bb8-baf8-c6aa2465b8cd tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:04.843276 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4bd0dabf-814a-4bb8-baf8-c6aa2465b8cd tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:04.852875 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4bd0dabf-814a-4bb8-baf8-c6aa2465b8cd tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:04.852875 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4bd0dabf-814a-4bb8-baf8-c6aa2465b8cd tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:04.853990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4bd0dabf-814a-4bb8-baf8-c6aa2465b8cd tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:04.854502 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4bd0dabf-814a-4bb8-baf8-c6aa2465b8cd tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:04.923979 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-54455130-afa9-443a-80b0-89f6fc230b51 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:04.932386 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-54455130-afa9-443a-80b0-89f6fc230b51 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:04.934036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-54455130-afa9-443a-80b0-89f6fc230b51 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:04.935173 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-54455130-afa9-443a-80b0-89f6fc230b51 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.182431 Jul 28 06:41:04.935725 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 328/651] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:04 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:41:05.074037 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4bd0dabf-814a-4bb8-baf8-c6aa2465b8cd tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:05.082019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4bd0dabf-814a-4bb8-baf8-c6aa2465b8cd tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1513 microversion: 2.1 time: 0.246245 Jul 28 06:41:05.082595 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 324/652] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:04 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:05.690391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-1e55bf57-b732-494a-8b5b-52fc90a85b12 req-2ad07705-f884-4271-bf3f-1481e05fc120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9e64be-7751-4a35-9913-759b5aa65387", "tag": "547ddf0c-06c1-4016-890a-f31d53cfe707"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:05.700173 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-1e55bf57-b732-494a-8b5b-52fc90a85b12 req-2ad07705-f884-4271-bf3f-1481e05fc120 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:05.700605 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-1e55bf57-b732-494a-8b5b-52fc90a85b12 req-2ad07705-f884-4271-bf3f-1481e05fc120 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:05.713839 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-1e55bf57-b732-494a-8b5b-52fc90a85b12 req-2ad07705-f884-4271-bf3f-1481e05fc120 service nova] Creating event network-changed:547ddf0c-06c1-4016-890a-f31d53cfe707 for instance 3e9e64be-7751-4a35-9913-759b5aa65387 on hv-cinder-85060 Jul 28 06:41:05.721003 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-1e55bf57-b732-494a-8b5b-52fc90a85b12 req-2ad07705-f884-4271-bf3f-1481e05fc120 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034724 Jul 28 06:41:05.721678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 329/653] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:41:05.959794 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7f68626d-5e09-4bc4-9522-b7b8fdcfc908 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:05.960425 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7f68626d-5e09-4bc4-9522-b7b8fdcfc908 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:05.968358 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7f68626d-5e09-4bc4-9522-b7b8fdcfc908 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:05.969121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7f68626d-5e09-4bc4-9522-b7b8fdcfc908 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:05.970411 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7f68626d-5e09-4bc4-9522-b7b8fdcfc908 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:05.971072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7f68626d-5e09-4bc4-9522-b7b8fdcfc908 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:06.105888 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-fd832381-9590-449f-b25d-36cffcf88735 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:06.106558 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-fd832381-9590-449f-b25d-36cffcf88735 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:06.113872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd832381-9590-449f-b25d-36cffcf88735 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:06.114309 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd832381-9590-449f-b25d-36cffcf88735 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:06.115262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd832381-9590-449f-b25d-36cffcf88735 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:06.115689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd832381-9590-449f-b25d-36cffcf88735 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:06.170688 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7f68626d-5e09-4bc4-9522-b7b8fdcfc908 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:06.185753 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7f68626d-5e09-4bc4-9522-b7b8fdcfc908 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:06.190635 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7f68626d-5e09-4bc4-9522-b7b8fdcfc908 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:06.191919 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7f68626d-5e09-4bc4-9522-b7b8fdcfc908 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.236239 Jul 28 06:41:06.215090 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 325/654] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:05 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:06.298912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-fd832381-9590-449f-b25d-36cffcf88735 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:06.306804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-fd832381-9590-449f-b25d-36cffcf88735 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1513 microversion: 2.1 time: 0.206163 Jul 28 06:41:06.307384 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 330/655] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:06 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:06.753611 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7eb9f447-53b5-4be2-aa2a-af69bf40ae90 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-428082000"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:06.754150 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7eb9f447-53b5-4be2-aa2a-af69bf40ae90 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:06.761101 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7eb9f447-53b5-4be2-aa2a-af69bf40ae90 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:06.761785 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7eb9f447-53b5-4be2-aa2a-af69bf40ae90 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:06.762724 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7eb9f447-53b5-4be2-aa2a-af69bf40ae90 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:06.763343 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7eb9f447-53b5-4be2-aa2a-af69bf40ae90 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:06.894614 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.network.security_group_api [None req-7eb9f447-53b5-4be2-aa2a-af69bf40ae90 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Adding security group 5becbb74-1475-4908-8171-bfcddae7255c to port 547ddf0c-06c1-4016-890a-f31d53cfe707 Jul 28 06:41:07.226812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-04e787af-233c-4b71-b2ae-84ff8c3f80c9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:07.227528 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-04e787af-233c-4b71-b2ae-84ff8c3f80c9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:07.234257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-04e787af-233c-4b71-b2ae-84ff8c3f80c9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:07.235333 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-04e787af-233c-4b71-b2ae-84ff8c3f80c9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:07.236122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-04e787af-233c-4b71-b2ae-84ff8c3f80c9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:07.236560 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-04e787af-233c-4b71-b2ae-84ff8c3f80c9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:07.302912 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7eb9f447-53b5-4be2-aa2a-af69bf40ae90 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "POST /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/action" status: 202 len: 0 microversion: 2.1 time: 0.553417 Jul 28 06:41:07.303833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 326/656] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:41:06 2022] POST /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:41:07.313771 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1d148447-e0c6-41ad-9c69-f546b82d397c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:07.314332 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1d148447-e0c6-41ad-9c69-f546b82d397c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:07.321966 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1d148447-e0c6-41ad-9c69-f546b82d397c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:07.322979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1d148447-e0c6-41ad-9c69-f546b82d397c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:07.324266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1d148447-e0c6-41ad-9c69-f546b82d397c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:07.324266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1d148447-e0c6-41ad-9c69-f546b82d397c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:07.435157 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-04e787af-233c-4b71-b2ae-84ff8c3f80c9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:07.451573 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-04e787af-233c-4b71-b2ae-84ff8c3f80c9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:07.454090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-04e787af-233c-4b71-b2ae-84ff8c3f80c9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:07.456055 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-04e787af-233c-4b71-b2ae-84ff8c3f80c9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1751 microversion: 2.20 time: 0.233132 Jul 28 06:41:07.457883 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 331/657] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:07 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1751 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:41:07.463737 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-071852fb-5ff3-4d84-aa4c-ed4ab74ab92c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:07.464556 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-071852fb-5ff3-4d84-aa4c-ed4ab74ab92c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:07.473568 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-071852fb-5ff3-4d84-aa4c-ed4ab74ab92c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:07.474665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-071852fb-5ff3-4d84-aa4c-ed4ab74ab92c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:07.475918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-071852fb-5ff3-4d84-aa4c-ed4ab74ab92c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:07.476697 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-071852fb-5ff3-4d84-aa4c-ed4ab74ab92c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:07.481977 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:07.603883 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1d148447-e0c6-41ad-9c69-f546b82d397c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:07.614269 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1d148447-e0c6-41ad-9c69-f546b82d397c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1640 microversion: 2.1 time: 0.306425 Jul 28 06:41:07.618598 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 327/658] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:07 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1640 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:41:07.664645 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-071852fb-5ff3-4d84-aa4c-ed4ab74ab92c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:07.673610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-071852fb-5ff3-4d84-aa4c-ed4ab74ab92c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1513 microversion: 2.1 time: 0.213498 Jul 28 06:41:07.674205 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 332/659] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:07 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:07.736378 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-a1bad09a-225d-410f-af7d-3a2b33db722d req-8b37c4f8-684d-47ed-9128-75f01013a08f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9e64be-7751-4a35-9913-759b5aa65387", "tag": "547ddf0c-06c1-4016-890a-f31d53cfe707"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:07.746354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-a1bad09a-225d-410f-af7d-3a2b33db722d req-8b37c4f8-684d-47ed-9128-75f01013a08f service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:07.746808 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-a1bad09a-225d-410f-af7d-3a2b33db722d req-8b37c4f8-684d-47ed-9128-75f01013a08f service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:07.759714 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-a1bad09a-225d-410f-af7d-3a2b33db722d req-8b37c4f8-684d-47ed-9128-75f01013a08f service nova] Creating event network-changed:547ddf0c-06c1-4016-890a-f31d53cfe707 for instance 3e9e64be-7751-4a35-9913-759b5aa65387 on hv-cinder-85060 Jul 28 06:41:07.764980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-a1bad09a-225d-410f-af7d-3a2b33db722d req-8b37c4f8-684d-47ed-9128-75f01013a08f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033038 Jul 28 06:41:07.765954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 328/660] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:41:08.480126 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f0dc0373-4333-436c-9ce8-b142fcee5011 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:08.480844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f0dc0373-4333-436c-9ce8-b142fcee5011 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:08.487977 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f0dc0373-4333-436c-9ce8-b142fcee5011 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:08.488422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f0dc0373-4333-436c-9ce8-b142fcee5011 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:08.489311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f0dc0373-4333-436c-9ce8-b142fcee5011 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:08.489755 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f0dc0373-4333-436c-9ce8-b142fcee5011 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:08.621512 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-79160655-0488-4b12-b07e-dce26450ead1 req-53755ee7-cfc2-44d3-8232-50de4f400034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88edfe-4077-4ab9-a0aa-4225d54024a7", "name": "network-vif-deleted", "tag": "41dcf4e4-f335-41a8-ae56-b0163407fe77"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:08.633021 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-79160655-0488-4b12-b07e-dce26450ead1 req-53755ee7-cfc2-44d3-8232-50de4f400034 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:08.633493 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-79160655-0488-4b12-b07e-dce26450ead1 req-53755ee7-cfc2-44d3-8232-50de4f400034 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:08.644990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-79160655-0488-4b12-b07e-dce26450ead1 req-53755ee7-cfc2-44d3-8232-50de4f400034 service nova] Creating event network-vif-deleted:41dcf4e4-f335-41a8-ae56-b0163407fe77 for instance 4d88edfe-4077-4ab9-a0aa-4225d54024a7 on hv-cinder-85060 Jul 28 06:41:08.649943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-79160655-0488-4b12-b07e-dce26450ead1 req-53755ee7-cfc2-44d3-8232-50de4f400034 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032466 Jul 28 06:41:08.650696 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 329/661] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:41:08.680063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f0dc0373-4333-436c-9ce8-b142fcee5011 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:08.689519 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f0dc0373-4333-436c-9ce8-b142fcee5011 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:08.691045 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f0dc0373-4333-436c-9ce8-b142fcee5011 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:08.692207 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f0dc0373-4333-436c-9ce8-b142fcee5011 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.216054 Jul 28 06:41:08.692765 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 333/662] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:08 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:08.695500 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-abef93ab-e156-4c87-8539-18c12bf35a36 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:08.696188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-abef93ab-e156-4c87-8539-18c12bf35a36 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:08.702586 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-abef93ab-e156-4c87-8539-18c12bf35a36 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:08.703110 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-abef93ab-e156-4c87-8539-18c12bf35a36 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:08.703870 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-abef93ab-e156-4c87-8539-18c12bf35a36 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:08.704298 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-abef93ab-e156-4c87-8539-18c12bf35a36 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:08.772144 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-abef93ab-e156-4c87-8539-18c12bf35a36 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:08.779746 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-abef93ab-e156-4c87-8539-18c12bf35a36 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 200 len: 1471 microversion: 2.1 time: 0.088635 Jul 28 06:41:08.780305 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 330/663] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:08 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 1471 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:41:09.715930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-79535922-8823-4b34-b30b-61d9671d6c16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:09.716539 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-79535922-8823-4b34-b30b-61d9671d6c16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:09.724250 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-79535922-8823-4b34-b30b-61d9671d6c16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:09.724702 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-79535922-8823-4b34-b30b-61d9671d6c16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:09.725518 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-79535922-8823-4b34-b30b-61d9671d6c16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:09.725934 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-79535922-8823-4b34-b30b-61d9671d6c16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:09.805347 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-645abedb-3c1b-4318-87d0-582d190723f3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:09.807089 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-645abedb-3c1b-4318-87d0-582d190723f3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 4d88edfe-4077-4ab9-a0aa-4225d54024a7] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:09.816720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-645abedb-3c1b-4318-87d0-582d190723f3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:09.817685 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-645abedb-3c1b-4318-87d0-582d190723f3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:09.819237 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-645abedb-3c1b-4318-87d0-582d190723f3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:09.819887 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-645abedb-3c1b-4318-87d0-582d190723f3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:09.843574 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-645abedb-3c1b-4318-87d0-582d190723f3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] HTTP exception thrown: Instance 4d88edfe-4077-4ab9-a0aa-4225d54024a7 could not be found. Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-645abedb-3c1b-4318-87d0-582d190723f3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Request method failure captured: Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 HTTP/1.1 Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i8ZFjWdB5nIf16_Rd6c0QpOmRcEtRSkEme8rbkvle3C4dWZKqkRLbArETvhmWBL7nsNvMCBJSkOOTgtkVNQ8G5z4UFrwvSc4dMw9kZvFX5nhHc6ibW9zAJSTCHMyU2HC_5iPlyQrJ7Oq7RIA4D4EXJefhHTOI7Wp2qhrDiJPuLue2I Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: bafc15c173f94f8eb804e56a2d4673a8 Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-VolumesSnapshotTestJSON-124019393 Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:41:09.846151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bafc15c173f94f8eb804e56a2d4673a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bafc15c173f94f8eb804e56a2d4673a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bafc15c173f94f8eb804e56a2d4673a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bafc15c173f94f8eb804e56a2d4673a8"}]}] Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-VolumesSnapshotTestJSON-124019393 Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: bafc15c173f94f8eb804e56a2d4673a8 Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-124019393 Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-VolumesSnapshotTestJSON-124019393-project Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: bb9f183ac716439aab70e789f9561901 Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-VolumesSnapshotTestJSON-124019393-project Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 4d88edfe-4077-4ab9-a0aa-4225d54024a7 could not be found. Jul 28 06:41:09.847604 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '4d88edfe-4077-4ab9-a0aa-4225d54024a7'} Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d88edfe-4077-4ab9-a0aa-4225d54024a7 could not be found. Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:41:09.848572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d88edfe-4077-4ab9-a0aa-4225d54024a7 could not be found. Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d88edfe-4077-4ab9-a0aa-4225d54024a7 could not be found. Jul 28 06:41:09.850210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:41:09.851668 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-645abedb-3c1b-4318-87d0-582d190723f3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Returning 404 to user: Instance 4d88edfe-4077-4ab9-a0aa-4225d54024a7 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:41:09.851668 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-645abedb-3c1b-4318-87d0-582d190723f3 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7" status: 404 len: 111 microversion: 2.1 time: 0.047338 Jul 28 06:41:09.851668 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 331/664] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:09 2022] GET /compute/v2.1/servers/4d88edfe-4077-4ab9-a0aa-4225d54024a7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:41:09.970408 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-79535922-8823-4b34-b30b-61d9671d6c16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:09.981310 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-79535922-8823-4b34-b30b-61d9671d6c16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:09.983112 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-79535922-8823-4b34-b30b-61d9671d6c16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:09.984778 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-79535922-8823-4b34-b30b-61d9671d6c16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.272367 Jul 28 06:41:09.997464 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 334/665] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:09 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:41:11.009516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b8ac6ec9-1a0b-4ee4-8740-a9d8e5d980e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:11.010122 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b8ac6ec9-1a0b-4ee4-8740-a9d8e5d980e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:11.017465 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b8ac6ec9-1a0b-4ee4-8740-a9d8e5d980e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:11.017914 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b8ac6ec9-1a0b-4ee4-8740-a9d8e5d980e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:11.018674 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b8ac6ec9-1a0b-4ee4-8740-a9d8e5d980e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:11.019108 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b8ac6ec9-1a0b-4ee4-8740-a9d8e5d980e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:11.151429 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b8ac6ec9-1a0b-4ee4-8740-a9d8e5d980e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:11.160961 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b8ac6ec9-1a0b-4ee4-8740-a9d8e5d980e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:11.162499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b8ac6ec9-1a0b-4ee4-8740-a9d8e5d980e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:11.163675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b8ac6ec9-1a0b-4ee4-8740-a9d8e5d980e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.158201 Jul 28 06:41:11.164231 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 332/666] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:11 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:12.186305 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5746f9bf-ad55-490d-8de1-1b826144f651 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:12.187013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5746f9bf-ad55-490d-8de1-1b826144f651 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:12.194031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5746f9bf-ad55-490d-8de1-1b826144f651 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:12.194473 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5746f9bf-ad55-490d-8de1-1b826144f651 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:12.195258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5746f9bf-ad55-490d-8de1-1b826144f651 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:12.195692 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5746f9bf-ad55-490d-8de1-1b826144f651 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:12.329966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5746f9bf-ad55-490d-8de1-1b826144f651 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:12.338282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5746f9bf-ad55-490d-8de1-1b826144f651 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:12.339805 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5746f9bf-ad55-490d-8de1-1b826144f651 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:12.341008 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5746f9bf-ad55-490d-8de1-1b826144f651 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.158585 Jul 28 06:41:12.341812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 335/667] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:12 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:13.365799 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8a55b83e-670e-4582-8f3a-c8877eb8eeee tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:13.366405 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8a55b83e-670e-4582-8f3a-c8877eb8eeee tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:13.372833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a55b83e-670e-4582-8f3a-c8877eb8eeee tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:13.373279 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a55b83e-670e-4582-8f3a-c8877eb8eeee tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:13.374056 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a55b83e-670e-4582-8f3a-c8877eb8eeee tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:13.374490 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a55b83e-670e-4582-8f3a-c8877eb8eeee tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:13.509654 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8a55b83e-670e-4582-8f3a-c8877eb8eeee tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:13.518485 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8a55b83e-670e-4582-8f3a-c8877eb8eeee tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:13.519978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8a55b83e-670e-4582-8f3a-c8877eb8eeee tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:13.521133 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8a55b83e-670e-4582-8f3a-c8877eb8eeee tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.159262 Jul 28 06:41:13.521732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 333/668] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:13 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:14.545738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b3c05df6-0e5d-4a89-b29c-5f5b5f5cfb18 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:14.547053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b3c05df6-0e5d-4a89-b29c-5f5b5f5cfb18 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:14.553819 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b3c05df6-0e5d-4a89-b29c-5f5b5f5cfb18 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:14.554276 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b3c05df6-0e5d-4a89-b29c-5f5b5f5cfb18 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:14.555057 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b3c05df6-0e5d-4a89-b29c-5f5b5f5cfb18 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:14.555498 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b3c05df6-0e5d-4a89-b29c-5f5b5f5cfb18 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:14.698062 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b3c05df6-0e5d-4a89-b29c-5f5b5f5cfb18 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:14.711301 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b3c05df6-0e5d-4a89-b29c-5f5b5f5cfb18 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:14.712795 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b3c05df6-0e5d-4a89-b29c-5f5b5f5cfb18 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:14.713992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b3c05df6-0e5d-4a89-b29c-5f5b5f5cfb18 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.172310 Jul 28 06:41:14.714545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 336/669] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:14 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:15.738345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dd91bcbb-5ec6-486b-8909-cd0256278cd9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:15.738961 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-dd91bcbb-5ec6-486b-8909-cd0256278cd9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:15.746061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd91bcbb-5ec6-486b-8909-cd0256278cd9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:15.746518 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd91bcbb-5ec6-486b-8909-cd0256278cd9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:15.747429 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd91bcbb-5ec6-486b-8909-cd0256278cd9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:15.747869 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd91bcbb-5ec6-486b-8909-cd0256278cd9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:15.880698 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dd91bcbb-5ec6-486b-8909-cd0256278cd9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:15.889098 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dd91bcbb-5ec6-486b-8909-cd0256278cd9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:15.891329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dd91bcbb-5ec6-486b-8909-cd0256278cd9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:15.892531 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-dd91bcbb-5ec6-486b-8909-cd0256278cd9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.159078 Jul 28 06:41:15.893085 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 334/670] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:15 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:16.915890 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-37950e40-0c47-4106-af1c-f25a4faf1b43 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:16.916502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-37950e40-0c47-4106-af1c-f25a4faf1b43 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:16.924072 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-37950e40-0c47-4106-af1c-f25a4faf1b43 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:16.924548 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-37950e40-0c47-4106-af1c-f25a4faf1b43 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:16.925378 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-37950e40-0c47-4106-af1c-f25a4faf1b43 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:16.925818 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-37950e40-0c47-4106-af1c-f25a4faf1b43 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:17.069054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-37950e40-0c47-4106-af1c-f25a4faf1b43 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:17.077962 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-37950e40-0c47-4106-af1c-f25a4faf1b43 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:17.079472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-37950e40-0c47-4106-af1c-f25a4faf1b43 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:17.080632 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-37950e40-0c47-4106-af1c-f25a4faf1b43 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.168679 Jul 28 06:41:17.081195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 337/671] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:16 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:18.104668 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-010a470f-1c8d-4426-9ef9-f6f46551e380 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:18.105514 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-010a470f-1c8d-4426-9ef9-f6f46551e380 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:18.112652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-010a470f-1c8d-4426-9ef9-f6f46551e380 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:18.113192 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-010a470f-1c8d-4426-9ef9-f6f46551e380 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:18.114108 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-010a470f-1c8d-4426-9ef9-f6f46551e380 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:18.114616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-010a470f-1c8d-4426-9ef9-f6f46551e380 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:18.255270 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-010a470f-1c8d-4426-9ef9-f6f46551e380 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:18.264442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-010a470f-1c8d-4426-9ef9-f6f46551e380 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:18.266548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-010a470f-1c8d-4426-9ef9-f6f46551e380 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:18.268233 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-010a470f-1c8d-4426-9ef9-f6f46551e380 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.167617 Jul 28 06:41:18.268561 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 335/672] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:18 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:19.298295 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c1cbe0ef-0a6d-46f7-9277-0bd5c10a8de8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:19.299014 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c1cbe0ef-0a6d-46f7-9277-0bd5c10a8de8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:19.305408 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c1cbe0ef-0a6d-46f7-9277-0bd5c10a8de8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:19.305867 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c1cbe0ef-0a6d-46f7-9277-0bd5c10a8de8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:19.306641 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c1cbe0ef-0a6d-46f7-9277-0bd5c10a8de8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:19.307082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c1cbe0ef-0a6d-46f7-9277-0bd5c10a8de8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:19.447857 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c1cbe0ef-0a6d-46f7-9277-0bd5c10a8de8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:19.457983 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c1cbe0ef-0a6d-46f7-9277-0bd5c10a8de8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:19.459507 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c1cbe0ef-0a6d-46f7-9277-0bd5c10a8de8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:19.460998 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c1cbe0ef-0a6d-46f7-9277-0bd5c10a8de8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.173447 Jul 28 06:41:19.469352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 338/673] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:19 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:19.899023 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-830093786", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "networks": [{"uuid": "c3ce7e55-3e64-4d32-b695-8bbb88b7772d"}]}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:19.968677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] validate_networks() for [('c3ce7e55-3e64-4d32-b695-8bbb88b7772d', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:41:20.340669 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:41:20.341089 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:41:20.341593 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:41:20.342001 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:41:20.342408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:41:20.345347 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:20.365082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:20.365082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:20.365082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:20.365082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:20.379220 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Getting quotas for project bafc15c173f94f8eb804e56a2d4673a8. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:41:20.383241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Getting quotas for user bb9f183ac716439aab70e789f9561901 and project bafc15c173f94f8eb804e56a2d4673a8. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:41:20.395417 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:41:20.397717 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:41:20.445858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-db2813c7-4e15-4cb1-8543-d339a1d85c32 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550674 Jul 28 06:41:20.446495 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 336/674] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:41:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:41:20.457918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4abf77f3-6bba-4b12-a634-e01c0de974c4 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:20.458554 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4abf77f3-6bba-4b12-a634-e01c0de974c4 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:20.486410 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9b92aef4-c8da-406f-9b9f-1fc29f147bb3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:20.487029 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9b92aef4-c8da-406f-9b9f-1fc29f147bb3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:20.501810 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9b92aef4-c8da-406f-9b9f-1fc29f147bb3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:20.505721 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9b92aef4-c8da-406f-9b9f-1fc29f147bb3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:20.506741 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9b92aef4-c8da-406f-9b9f-1fc29f147bb3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:20.507337 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9b92aef4-c8da-406f-9b9f-1fc29f147bb3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:20.522867 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4abf77f3-6bba-4b12-a634-e01c0de974c4 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:20.529412 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4abf77f3-6bba-4b12-a634-e01c0de974c4 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1218 microversion: 2.1 time: 0.075975 Jul 28 06:41:20.543943 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 339/675] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:20 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:20.665818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9b92aef4-c8da-406f-9b9f-1fc29f147bb3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:20.674998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9b92aef4-c8da-406f-9b9f-1fc29f147bb3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:20.676503 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9b92aef4-c8da-406f-9b9f-1fc29f147bb3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:20.677712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9b92aef4-c8da-406f-9b9f-1fc29f147bb3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.196176 Jul 28 06:41:20.678373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 337/676] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:20 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:41:21.552241 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-52e3b24b-a1d4-488a-ac4c-ba87f63b1155 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:21.552899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-52e3b24b-a1d4-488a-ac4c-ba87f63b1155 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:21.560038 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-52e3b24b-a1d4-488a-ac4c-ba87f63b1155 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:21.560491 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-52e3b24b-a1d4-488a-ac4c-ba87f63b1155 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:21.561258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-52e3b24b-a1d4-488a-ac4c-ba87f63b1155 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:21.561720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-52e3b24b-a1d4-488a-ac4c-ba87f63b1155 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:21.627537 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-52e3b24b-a1d4-488a-ac4c-ba87f63b1155 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:21.635374 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-52e3b24b-a1d4-488a-ac4c-ba87f63b1155 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1222 microversion: 2.1 time: 0.088085 Jul 28 06:41:21.635975 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 340/677] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:21 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:21.700779 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5fc156d5-82ce-444c-9f4e-411d3f68ab12 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:21.701522 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5fc156d5-82ce-444c-9f4e-411d3f68ab12 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:21.708878 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5fc156d5-82ce-444c-9f4e-411d3f68ab12 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:21.709359 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5fc156d5-82ce-444c-9f4e-411d3f68ab12 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:21.710130 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5fc156d5-82ce-444c-9f4e-411d3f68ab12 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:21.710568 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5fc156d5-82ce-444c-9f4e-411d3f68ab12 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:21.854465 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5fc156d5-82ce-444c-9f4e-411d3f68ab12 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:21.863593 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5fc156d5-82ce-444c-9f4e-411d3f68ab12 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:21.865174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5fc156d5-82ce-444c-9f4e-411d3f68ab12 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:21.866361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5fc156d5-82ce-444c-9f4e-411d3f68ab12 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.169490 Jul 28 06:41:21.866912 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 338/678] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:21 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:22.657720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-373c93b4-9f87-4a60-be71-9902c28af3fb tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:22.658438 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-373c93b4-9f87-4a60-be71-9902c28af3fb tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:22.666443 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-373c93b4-9f87-4a60-be71-9902c28af3fb tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:22.666886 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-373c93b4-9f87-4a60-be71-9902c28af3fb tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:22.668176 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-373c93b4-9f87-4a60-be71-9902c28af3fb tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:22.669022 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-373c93b4-9f87-4a60-be71-9902c28af3fb tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:22.732545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-373c93b4-9f87-4a60-be71-9902c28af3fb tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:22.740075 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-373c93b4-9f87-4a60-be71-9902c28af3fb tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1222 microversion: 2.1 time: 0.087663 Jul 28 06:41:22.740643 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 341/679] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:22 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:22.891384 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c58d9c31-3eee-447a-a46f-84ffa28cb24e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:22.892006 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c58d9c31-3eee-447a-a46f-84ffa28cb24e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:22.898483 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c58d9c31-3eee-447a-a46f-84ffa28cb24e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:22.898956 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c58d9c31-3eee-447a-a46f-84ffa28cb24e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:22.899829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c58d9c31-3eee-447a-a46f-84ffa28cb24e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:22.900286 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c58d9c31-3eee-447a-a46f-84ffa28cb24e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:23.038588 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c58d9c31-3eee-447a-a46f-84ffa28cb24e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:23.047375 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c58d9c31-3eee-447a-a46f-84ffa28cb24e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:23.050014 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c58d9c31-3eee-447a-a46f-84ffa28cb24e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:23.051366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c58d9c31-3eee-447a-a46f-84ffa28cb24e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.163998 Jul 28 06:41:23.052720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 339/680] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:22 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:23.761818 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ae01a790-bead-488b-8d1b-310536a172e5 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:23.762482 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ae01a790-bead-488b-8d1b-310536a172e5 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:23.769218 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ae01a790-bead-488b-8d1b-310536a172e5 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:23.769704 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ae01a790-bead-488b-8d1b-310536a172e5 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:23.770505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ae01a790-bead-488b-8d1b-310536a172e5 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:23.770956 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ae01a790-bead-488b-8d1b-310536a172e5 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:23.833525 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ae01a790-bead-488b-8d1b-310536a172e5 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:23.841149 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ae01a790-bead-488b-8d1b-310536a172e5 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1222 microversion: 2.1 time: 0.083209 Jul 28 06:41:23.845390 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 342/681] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:23 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:24.075670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-421b618c-1956-45d0-9b0c-bd306aa84283 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:24.076358 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-421b618c-1956-45d0-9b0c-bd306aa84283 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:24.083270 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-421b618c-1956-45d0-9b0c-bd306aa84283 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:24.083717 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-421b618c-1956-45d0-9b0c-bd306aa84283 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:24.084480 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-421b618c-1956-45d0-9b0c-bd306aa84283 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:24.084920 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-421b618c-1956-45d0-9b0c-bd306aa84283 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:24.221050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-421b618c-1956-45d0-9b0c-bd306aa84283 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:24.229851 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-421b618c-1956-45d0-9b0c-bd306aa84283 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:24.231351 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-421b618c-1956-45d0-9b0c-bd306aa84283 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:24.237631 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-421b618c-1956-45d0-9b0c-bd306aa84283 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.160915 Jul 28 06:41:24.238455 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 340/682] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:24 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:41:24.864746 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b56716b7-15d0-4bf8-adb2-570213cdd138 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:24.865433 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b56716b7-15d0-4bf8-adb2-570213cdd138 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:24.871961 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b56716b7-15d0-4bf8-adb2-570213cdd138 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:24.872407 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b56716b7-15d0-4bf8-adb2-570213cdd138 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:24.873167 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b56716b7-15d0-4bf8-adb2-570213cdd138 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:24.873636 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b56716b7-15d0-4bf8-adb2-570213cdd138 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:24.936550 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b56716b7-15d0-4bf8-adb2-570213cdd138 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:24.945346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b56716b7-15d0-4bf8-adb2-570213cdd138 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1222 microversion: 2.1 time: 0.085899 Jul 28 06:41:24.946166 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 343/683] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:24 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:25.261529 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5836505a-874b-470d-bb10-fd17b8556baa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:25.262146 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5836505a-874b-470d-bb10-fd17b8556baa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:25.271025 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5836505a-874b-470d-bb10-fd17b8556baa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:25.271474 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5836505a-874b-470d-bb10-fd17b8556baa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:25.272245 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5836505a-874b-470d-bb10-fd17b8556baa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:25.272686 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5836505a-874b-470d-bb10-fd17b8556baa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:25.407355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5836505a-874b-470d-bb10-fd17b8556baa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:25.416252 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5836505a-874b-470d-bb10-fd17b8556baa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:25.417872 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5836505a-874b-470d-bb10-fd17b8556baa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:25.419173 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5836505a-874b-470d-bb10-fd17b8556baa tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.161865 Jul 28 06:41:25.419760 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 341/684] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:25 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:25.965771 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-79ddda8b-c210-4000-858e-92e819a97f8a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:25.966488 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-79ddda8b-c210-4000-858e-92e819a97f8a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:25.974543 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-79ddda8b-c210-4000-858e-92e819a97f8a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:25.974988 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-79ddda8b-c210-4000-858e-92e819a97f8a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:25.975754 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-79ddda8b-c210-4000-858e-92e819a97f8a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:25.976191 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-79ddda8b-c210-4000-858e-92e819a97f8a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:26.046916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-79ddda8b-c210-4000-858e-92e819a97f8a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:26.054998 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-79ddda8b-c210-4000-858e-92e819a97f8a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1222 microversion: 2.1 time: 0.093094 Jul 28 06:41:26.055566 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 344/685] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:25 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:26.444034 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9a10c81a-22be-470d-bfc0-14a82c26c95a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:26.444605 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9a10c81a-22be-470d-bfc0-14a82c26c95a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:26.451188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9a10c81a-22be-470d-bfc0-14a82c26c95a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:26.451642 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9a10c81a-22be-470d-bfc0-14a82c26c95a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:26.452413 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9a10c81a-22be-470d-bfc0-14a82c26c95a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:26.452855 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9a10c81a-22be-470d-bfc0-14a82c26c95a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:26.468302 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:26.586498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9a10c81a-22be-470d-bfc0-14a82c26c95a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:26.595598 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9a10c81a-22be-470d-bfc0-14a82c26c95a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:26.597189 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9a10c81a-22be-470d-bfc0-14a82c26c95a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:26.598378 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9a10c81a-22be-470d-bfc0-14a82c26c95a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.158596 Jul 28 06:41:26.598929 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 342/686] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:26 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:27.076279 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-dee5a3ce-c38d-41dc-bcc3-ca6c2f2a0dc7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:27.077258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-dee5a3ce-c38d-41dc-bcc3-ca6c2f2a0dc7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:27.084755 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dee5a3ce-c38d-41dc-bcc3-ca6c2f2a0dc7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:27.085246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dee5a3ce-c38d-41dc-bcc3-ca6c2f2a0dc7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:27.086135 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dee5a3ce-c38d-41dc-bcc3-ca6c2f2a0dc7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:27.086577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dee5a3ce-c38d-41dc-bcc3-ca6c2f2a0dc7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:27.149555 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-dee5a3ce-c38d-41dc-bcc3-ca6c2f2a0dc7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:27.157367 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-dee5a3ce-c38d-41dc-bcc3-ca6c2f2a0dc7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1214 microversion: 2.1 time: 0.084778 Jul 28 06:41:27.157802 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 345/687] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:27 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:27.620607 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ae13eb30-fe1f-4fe0-b752-c470157f687a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:27.621231 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ae13eb30-fe1f-4fe0-b752-c470157f687a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:27.627712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae13eb30-fe1f-4fe0-b752-c470157f687a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:27.628155 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae13eb30-fe1f-4fe0-b752-c470157f687a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:27.628903 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae13eb30-fe1f-4fe0-b752-c470157f687a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:27.629359 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ae13eb30-fe1f-4fe0-b752-c470157f687a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:27.761574 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ae13eb30-fe1f-4fe0-b752-c470157f687a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:27.770797 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ae13eb30-fe1f-4fe0-b752-c470157f687a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:27.772276 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ae13eb30-fe1f-4fe0-b752-c470157f687a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:27.773448 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ae13eb30-fe1f-4fe0-b752-c470157f687a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.156703 Jul 28 06:41:27.774001 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 343/688] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:27 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:28.178110 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c829162c-fc29-44f8-a575-41b63208c382 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:28.178752 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c829162c-fc29-44f8-a575-41b63208c382 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:28.185161 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c829162c-fc29-44f8-a575-41b63208c382 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:28.185640 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c829162c-fc29-44f8-a575-41b63208c382 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:28.186400 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c829162c-fc29-44f8-a575-41b63208c382 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:28.186868 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c829162c-fc29-44f8-a575-41b63208c382 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:28.249173 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c829162c-fc29-44f8-a575-41b63208c382 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:28.257034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c829162c-fc29-44f8-a575-41b63208c382 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1270 microversion: 2.1 time: 0.082783 Jul 28 06:41:28.257628 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 346/689] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:28 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:28.796542 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-09077c30-3a7a-4874-b608-69168fb862cd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:28.797143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-09077c30-3a7a-4874-b608-69168fb862cd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:28.805078 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09077c30-3a7a-4874-b608-69168fb862cd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:28.805568 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09077c30-3a7a-4874-b608-69168fb862cd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:28.806355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09077c30-3a7a-4874-b608-69168fb862cd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:28.806792 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09077c30-3a7a-4874-b608-69168fb862cd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:29.016353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-09077c30-3a7a-4874-b608-69168fb862cd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:29.025123 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-09077c30-3a7a-4874-b608-69168fb862cd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:29.026831 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-09077c30-3a7a-4874-b608-69168fb862cd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:29.028071 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-09077c30-3a7a-4874-b608-69168fb862cd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.235518 Jul 28 06:41:29.028630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 344/690] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:28 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:29.279457 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ef631e93-f932-4b72-bdab-40f900c3cb04 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:29.280153 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ef631e93-f932-4b72-bdab-40f900c3cb04 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:29.284279 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=52 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:29.288608 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ef631e93-f932-4b72-bdab-40f900c3cb04 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:29.289209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ef631e93-f932-4b72-bdab-40f900c3cb04 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:29.290047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ef631e93-f932-4b72-bdab-40f900c3cb04 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:29.290488 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ef631e93-f932-4b72-bdab-40f900c3cb04 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:29.429804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ef631e93-f932-4b72-bdab-40f900c3cb04 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:29.438194 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ef631e93-f932-4b72-bdab-40f900c3cb04 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1318 microversion: 2.1 time: 0.162728 Jul 28 06:41:29.439591 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 347/691] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:29 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:29.985949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-73db646c-b604-4c5f-8c83-5bb6a1bb8248 req-da89be56-ae3c-4e8b-b8ec-3fd1fdf328bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e6b8321-acd0-40c7-ac20-a016af964766", "tag": "d5ab285a-d02e-4ade-81d1-f6bd40c669f7"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:29.996948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-73db646c-b604-4c5f-8c83-5bb6a1bb8248 req-da89be56-ae3c-4e8b-b8ec-3fd1fdf328bc service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:29.997462 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-73db646c-b604-4c5f-8c83-5bb6a1bb8248 req-da89be56-ae3c-4e8b-b8ec-3fd1fdf328bc service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:30.009410 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-73db646c-b604-4c5f-8c83-5bb6a1bb8248 req-da89be56-ae3c-4e8b-b8ec-3fd1fdf328bc service nova] Creating event network-changed:d5ab285a-d02e-4ade-81d1-f6bd40c669f7 for instance 9e6b8321-acd0-40c7-ac20-a016af964766 on hv-cinder-85060 Jul 28 06:41:30.014256 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-73db646c-b604-4c5f-8c83-5bb6a1bb8248 req-da89be56-ae3c-4e8b-b8ec-3fd1fdf328bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033018 Jul 28 06:41:30.014839 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 345/692] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:41:30.051445 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2e049705-18d2-425c-b7ec-87158918b387 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:30.052480 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2e049705-18d2-425c-b7ec-87158918b387 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:30.058769 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e049705-18d2-425c-b7ec-87158918b387 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:30.059225 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e049705-18d2-425c-b7ec-87158918b387 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:30.060010 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e049705-18d2-425c-b7ec-87158918b387 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:30.060448 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e049705-18d2-425c-b7ec-87158918b387 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:30.192318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2e049705-18d2-425c-b7ec-87158918b387 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:30.201144 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2e049705-18d2-425c-b7ec-87158918b387 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:30.202669 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2e049705-18d2-425c-b7ec-87158918b387 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:30.204351 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2e049705-18d2-425c-b7ec-87158918b387 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.156256 Jul 28 06:41:30.205077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 348/693] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:30 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:30.459232 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:30.460356 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=6 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:30.464732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5b201ac9-c08a-4aa6-bd7e-86d06b558c90 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:30.465456 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5b201ac9-c08a-4aa6-bd7e-86d06b558c90 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:30.472460 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b201ac9-c08a-4aa6-bd7e-86d06b558c90 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:30.472904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b201ac9-c08a-4aa6-bd7e-86d06b558c90 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:30.473687 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b201ac9-c08a-4aa6-bd7e-86d06b558c90 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:30.474123 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b201ac9-c08a-4aa6-bd7e-86d06b558c90 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:30.606274 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5b201ac9-c08a-4aa6-bd7e-86d06b558c90 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:30.613877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5b201ac9-c08a-4aa6-bd7e-86d06b558c90 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1318 microversion: 2.1 time: 0.156307 Jul 28 06:41:30.614453 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 346/694] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:30 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:31.229045 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9e66d023-1651-498e-bc72-765b266d1ef4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:31.229681 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9e66d023-1651-498e-bc72-765b266d1ef4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:31.231990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:31.238785 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e66d023-1651-498e-bc72-765b266d1ef4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:31.239230 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e66d023-1651-498e-bc72-765b266d1ef4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:31.239990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e66d023-1651-498e-bc72-765b266d1ef4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:31.240423 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e66d023-1651-498e-bc72-765b266d1ef4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:31.372070 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9e66d023-1651-498e-bc72-765b266d1ef4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:31.374239 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:31.382638 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9e66d023-1651-498e-bc72-765b266d1ef4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:31.384133 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9e66d023-1651-498e-bc72-765b266d1ef4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:31.385272 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9e66d023-1651-498e-bc72-765b266d1ef4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.160132 Jul 28 06:41:31.385841 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 349/695] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:31 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:31.635772 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0bad6b02-7c10-40aa-ba39-aa7b863d289c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:31.636293 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0bad6b02-7c10-40aa-ba39-aa7b863d289c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:31.643282 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0bad6b02-7c10-40aa-ba39-aa7b863d289c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:31.643721 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0bad6b02-7c10-40aa-ba39-aa7b863d289c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:31.644472 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0bad6b02-7c10-40aa-ba39-aa7b863d289c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:31.644900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0bad6b02-7c10-40aa-ba39-aa7b863d289c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:32.096535 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0bad6b02-7c10-40aa-ba39-aa7b863d289c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:32.108083 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0bad6b02-7c10-40aa-ba39-aa7b863d289c tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1318 microversion: 2.1 time: 0.476144 Jul 28 06:41:32.108657 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 347/696] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:31 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:32.409320 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b0ffba21-deec-45f1-9c6d-9f045fd64732 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:32.410077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b0ffba21-deec-45f1-9c6d-9f045fd64732 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:32.416507 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0ffba21-deec-45f1-9c6d-9f045fd64732 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:32.416959 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0ffba21-deec-45f1-9c6d-9f045fd64732 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:32.417855 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0ffba21-deec-45f1-9c6d-9f045fd64732 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:32.418289 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0ffba21-deec-45f1-9c6d-9f045fd64732 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:32.555571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b0ffba21-deec-45f1-9c6d-9f045fd64732 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:32.564554 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b0ffba21-deec-45f1-9c6d-9f045fd64732 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:32.566209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b0ffba21-deec-45f1-9c6d-9f045fd64732 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:32.567366 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b0ffba21-deec-45f1-9c6d-9f045fd64732 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.163221 Jul 28 06:41:32.568197 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 350/697] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:32 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:33.133445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4bca78b4-df61-48ac-a070-66b1829e951a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:33.134076 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4bca78b4-df61-48ac-a070-66b1829e951a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:33.143042 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4bca78b4-df61-48ac-a070-66b1829e951a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:33.143624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4bca78b4-df61-48ac-a070-66b1829e951a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:33.144900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4bca78b4-df61-48ac-a070-66b1829e951a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:33.145668 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4bca78b4-df61-48ac-a070-66b1829e951a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:33.289313 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4bca78b4-df61-48ac-a070-66b1829e951a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:33.301170 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4bca78b4-df61-48ac-a070-66b1829e951a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1318 microversion: 2.1 time: 0.173543 Jul 28 06:41:33.301791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 348/698] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:33 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:33.590805 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9ea53e63-30a8-42f4-af5f-02da9bad85ad tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:33.591413 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9ea53e63-30a8-42f4-af5f-02da9bad85ad tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:33.598077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9ea53e63-30a8-42f4-af5f-02da9bad85ad tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:33.598528 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9ea53e63-30a8-42f4-af5f-02da9bad85ad tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:33.599298 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9ea53e63-30a8-42f4-af5f-02da9bad85ad tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:33.599739 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9ea53e63-30a8-42f4-af5f-02da9bad85ad tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:33.737849 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9ea53e63-30a8-42f4-af5f-02da9bad85ad tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:33.746210 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9ea53e63-30a8-42f4-af5f-02da9bad85ad tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:33.747713 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9ea53e63-30a8-42f4-af5f-02da9bad85ad tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:33.748855 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9ea53e63-30a8-42f4-af5f-02da9bad85ad tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.161978 Jul 28 06:41:33.749441 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 351/699] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:33 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:34.326320 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2ceb16d2-5e82-4a66-9ba8-9356ae230fb1 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:34.327498 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2ceb16d2-5e82-4a66-9ba8-9356ae230fb1 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:34.334554 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2ceb16d2-5e82-4a66-9ba8-9356ae230fb1 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:34.335009 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2ceb16d2-5e82-4a66-9ba8-9356ae230fb1 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:34.335764 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2ceb16d2-5e82-4a66-9ba8-9356ae230fb1 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:34.336203 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2ceb16d2-5e82-4a66-9ba8-9356ae230fb1 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:34.474283 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2ceb16d2-5e82-4a66-9ba8-9356ae230fb1 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:34.481798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2ceb16d2-5e82-4a66-9ba8-9356ae230fb1 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1318 microversion: 2.1 time: 0.159373 Jul 28 06:41:34.482352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 349/700] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:34 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:34.772745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d948f4d8-05b0-4738-873b-a6e09898469b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:34.773362 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d948f4d8-05b0-4738-873b-a6e09898469b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:34.779779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d948f4d8-05b0-4738-873b-a6e09898469b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:34.780216 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d948f4d8-05b0-4738-873b-a6e09898469b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:34.780972 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d948f4d8-05b0-4738-873b-a6e09898469b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:34.781426 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d948f4d8-05b0-4738-873b-a6e09898469b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:34.912946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d948f4d8-05b0-4738-873b-a6e09898469b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:34.921343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d948f4d8-05b0-4738-873b-a6e09898469b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:34.923104 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d948f4d8-05b0-4738-873b-a6e09898469b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:34.924264 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d948f4d8-05b0-4738-873b-a6e09898469b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.155440 Jul 28 06:41:34.924822 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 352/701] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:34 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:35.504215 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-62d7534c-0ec4-4abd-b50b-9e0250012850 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:35.504818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-62d7534c-0ec4-4abd-b50b-9e0250012850 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:35.511407 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-62d7534c-0ec4-4abd-b50b-9e0250012850 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:35.511858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-62d7534c-0ec4-4abd-b50b-9e0250012850 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:35.512624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-62d7534c-0ec4-4abd-b50b-9e0250012850 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:35.513060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-62d7534c-0ec4-4abd-b50b-9e0250012850 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:35.642170 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-62d7534c-0ec4-4abd-b50b-9e0250012850 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:35.649477 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-62d7534c-0ec4-4abd-b50b-9e0250012850 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1318 microversion: 2.1 time: 0.150032 Jul 28 06:41:35.650035 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 350/702] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:35 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:35.947738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a84de462-47e9-44f5-a64e-783428e6c521 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:35.948431 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a84de462-47e9-44f5-a64e-783428e6c521 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:35.955685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a84de462-47e9-44f5-a64e-783428e6c521 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:35.956136 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a84de462-47e9-44f5-a64e-783428e6c521 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:35.956919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a84de462-47e9-44f5-a64e-783428e6c521 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:35.957386 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a84de462-47e9-44f5-a64e-783428e6c521 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:36.007044 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-6d3eb2f3-9ff7-4e44-8ab8-32766d4ad258 req-55643fb6-b77a-415e-a2ab-1101dded7d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6b8321-acd0-40c7-ac20-a016af964766", "name": "network-vif-plugged", "status": "completed", "tag": "d5ab285a-d02e-4ade-81d1-f6bd40c669f7"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:36.029174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-6d3eb2f3-9ff7-4e44-8ab8-32766d4ad258 req-55643fb6-b77a-415e-a2ab-1101dded7d3b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:36.034819 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-6d3eb2f3-9ff7-4e44-8ab8-32766d4ad258 req-55643fb6-b77a-415e-a2ab-1101dded7d3b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:36.050247 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-6d3eb2f3-9ff7-4e44-8ab8-32766d4ad258 req-55643fb6-b77a-415e-a2ab-1101dded7d3b service nova] Creating event network-vif-plugged:d5ab285a-d02e-4ade-81d1-f6bd40c669f7 for instance 9e6b8321-acd0-40c7-ac20-a016af964766 on hv-cinder-85060 Jul 28 06:41:36.056048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-6d3eb2f3-9ff7-4e44-8ab8-32766d4ad258 req-55643fb6-b77a-415e-a2ab-1101dded7d3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052545 Jul 28 06:41:36.057460 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 351/703] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:41:36.114811 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a84de462-47e9-44f5-a64e-783428e6c521 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:36.123291 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a84de462-47e9-44f5-a64e-783428e6c521 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:36.124948 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a84de462-47e9-44f5-a64e-783428e6c521 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:36.127306 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a84de462-47e9-44f5-a64e-783428e6c521 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.183599 Jul 28 06:41:36.127947 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 353/704] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:35 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:36.671400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-31cbec3a-6fba-4a3a-b091-c7d58ac516a6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:36.672742 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-31cbec3a-6fba-4a3a-b091-c7d58ac516a6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:36.679750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-31cbec3a-6fba-4a3a-b091-c7d58ac516a6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:36.680204 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-31cbec3a-6fba-4a3a-b091-c7d58ac516a6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:36.680971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-31cbec3a-6fba-4a3a-b091-c7d58ac516a6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:36.681442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-31cbec3a-6fba-4a3a-b091-c7d58ac516a6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:36.816087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-31cbec3a-6fba-4a3a-b091-c7d58ac516a6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:36.823750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-31cbec3a-6fba-4a3a-b091-c7d58ac516a6 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1318 microversion: 2.1 time: 0.156548 Jul 28 06:41:36.824311 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 352/705] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:36 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:37.149996 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-8241d95f-6ae1-42be-aed0-ed97964d273f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:37.150596 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-8241d95f-6ae1-42be-aed0-ed97964d273f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:37.157333 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8241d95f-6ae1-42be-aed0-ed97964d273f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:37.157785 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8241d95f-6ae1-42be-aed0-ed97964d273f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:37.158537 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8241d95f-6ae1-42be-aed0-ed97964d273f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:37.158969 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8241d95f-6ae1-42be-aed0-ed97964d273f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:37.287594 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8241d95f-6ae1-42be-aed0-ed97964d273f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:37.296287 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8241d95f-6ae1-42be-aed0-ed97964d273f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:37.298602 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8241d95f-6ae1-42be-aed0-ed97964d273f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:37.299779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-8241d95f-6ae1-42be-aed0-ed97964d273f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.153673 Jul 28 06:41:37.300346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 354/706] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:37 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:37.846105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8a6d9e3c-8c8e-42e0-89bf-1cfb3b5ed357 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:37.846701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8a6d9e3c-8c8e-42e0-89bf-1cfb3b5ed357 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:37.861391 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a6d9e3c-8c8e-42e0-89bf-1cfb3b5ed357 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:37.861841 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a6d9e3c-8c8e-42e0-89bf-1cfb3b5ed357 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:37.862630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a6d9e3c-8c8e-42e0-89bf-1cfb3b5ed357 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:37.863061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a6d9e3c-8c8e-42e0-89bf-1cfb3b5ed357 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:38.003070 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8a6d9e3c-8c8e-42e0-89bf-1cfb3b5ed357 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:38.010642 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8a6d9e3c-8c8e-42e0-89bf-1cfb3b5ed357 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1318 microversion: 2.1 time: 0.169067 Jul 28 06:41:38.011217 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 353/707] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:37 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:38.095562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-2a223c10-0dd5-48ea-b6e7-5d8ba5022c49 req-e2c92d87-7bae-4381-836b-ed3c323ccebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019e1e9c-7545-477a-bae9-47c555ae07e2", "name": "network-vif-plugged", "status": "completed", "tag": "626917cf-1bf9-47dd-b3eb-784f6c8fdad0"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:38.106743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-2a223c10-0dd5-48ea-b6e7-5d8ba5022c49 req-e2c92d87-7bae-4381-836b-ed3c323ccebb service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:38.107757 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-2a223c10-0dd5-48ea-b6e7-5d8ba5022c49 req-e2c92d87-7bae-4381-836b-ed3c323ccebb service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:38.120786 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-2a223c10-0dd5-48ea-b6e7-5d8ba5022c49 req-e2c92d87-7bae-4381-836b-ed3c323ccebb service nova] Creating event network-vif-plugged:626917cf-1bf9-47dd-b3eb-784f6c8fdad0 for instance 019e1e9c-7545-477a-bae9-47c555ae07e2 on hv-cinder-85060 Jul 28 06:41:38.127479 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-2a223c10-0dd5-48ea-b6e7-5d8ba5022c49 req-e2c92d87-7bae-4381-836b-ed3c323ccebb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035827 Jul 28 06:41:38.128238 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 355/708] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:41:38.323544 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-bd4e6c3d-8574-4f1c-a35f-25021017d73d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:38.324074 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-bd4e6c3d-8574-4f1c-a35f-25021017d73d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:38.330529 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bd4e6c3d-8574-4f1c-a35f-25021017d73d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:38.330983 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bd4e6c3d-8574-4f1c-a35f-25021017d73d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:38.331749 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bd4e6c3d-8574-4f1c-a35f-25021017d73d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:38.332192 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bd4e6c3d-8574-4f1c-a35f-25021017d73d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:38.471041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-bd4e6c3d-8574-4f1c-a35f-25021017d73d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:38.480244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-bd4e6c3d-8574-4f1c-a35f-25021017d73d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:38.481858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-bd4e6c3d-8574-4f1c-a35f-25021017d73d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:38.483007 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-bd4e6c3d-8574-4f1c-a35f-25021017d73d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.163470 Jul 28 06:41:38.483562 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 354/709] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:38 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:39.033683 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-412c4675-b047-497a-95a5-800fb8073c67 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:39.035205 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-412c4675-b047-497a-95a5-800fb8073c67 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:39.041954 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-412c4675-b047-497a-95a5-800fb8073c67 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:39.042396 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-412c4675-b047-497a-95a5-800fb8073c67 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:39.043151 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-412c4675-b047-497a-95a5-800fb8073c67 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:39.043581 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-412c4675-b047-497a-95a5-800fb8073c67 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:39.173767 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-412c4675-b047-497a-95a5-800fb8073c67 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:39.181107 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-412c4675-b047-497a-95a5-800fb8073c67 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1506 microversion: 2.1 time: 0.151719 Jul 28 06:41:39.181704 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 356/710] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:39 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:39.202771 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b8cf4f97-7223-4b28-bc8c-559420fd9e3a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "205b2a8b-dd85-4dab-935f-a57c8d816993", "device": "/dev/sdb"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:39.206002 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b8cf4f97-7223-4b28-bc8c-559420fd9e3a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:39.212471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b8cf4f97-7223-4b28-bc8c-559420fd9e3a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:39.212927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b8cf4f97-7223-4b28-bc8c-559420fd9e3a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:39.213749 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b8cf4f97-7223-4b28-bc8c-559420fd9e3a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:39.214190 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b8cf4f97-7223-4b28-bc8c-559420fd9e3a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:39.496757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b8cf4f97-7223-4b28-bc8c-559420fd9e3a tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "POST /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297744 Jul 28 06:41:39.497377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 355/711] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:41:39 2022] POST /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:41:39.506145 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-73737b0c-8296-47f3-b0cd-12a9758a6b8e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:39.506977 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-73737b0c-8296-47f3-b0cd-12a9758a6b8e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:39.513162 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-73737b0c-8296-47f3-b0cd-12a9758a6b8e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:39.513672 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-73737b0c-8296-47f3-b0cd-12a9758a6b8e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:39.514434 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-73737b0c-8296-47f3-b0cd-12a9758a6b8e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:39.514872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-73737b0c-8296-47f3-b0cd-12a9758a6b8e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:39.644936 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-73737b0c-8296-47f3-b0cd-12a9758a6b8e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:39.653329 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-73737b0c-8296-47f3-b0cd-12a9758a6b8e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:39.654866 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-73737b0c-8296-47f3-b0cd-12a9758a6b8e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:39.656022 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-73737b0c-8296-47f3-b0cd-12a9758a6b8e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.153865 Jul 28 06:41:39.656580 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 357/712] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:39 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:40.680736 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6fa7df80-4347-4abf-ab32-c1981246f8be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:40.681452 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6fa7df80-4347-4abf-ab32-c1981246f8be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:40.687529 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6fa7df80-4347-4abf-ab32-c1981246f8be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:40.687974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6fa7df80-4347-4abf-ab32-c1981246f8be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:40.688762 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6fa7df80-4347-4abf-ab32-c1981246f8be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:40.689393 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6fa7df80-4347-4abf-ab32-c1981246f8be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:40.823273 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6fa7df80-4347-4abf-ab32-c1981246f8be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:40.832387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6fa7df80-4347-4abf-ab32-c1981246f8be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:40.833927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6fa7df80-4347-4abf-ab32-c1981246f8be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:40.835084 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6fa7df80-4347-4abf-ab32-c1981246f8be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.159259 Jul 28 06:41:40.835649 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 356/713] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:40 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:41:41.858220 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0438e3f8-e56c-41d8-b8ab-f1c6de52edb8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:41.858819 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0438e3f8-e56c-41d8-b8ab-f1c6de52edb8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:41.866191 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0438e3f8-e56c-41d8-b8ab-f1c6de52edb8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:41.866639 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0438e3f8-e56c-41d8-b8ab-f1c6de52edb8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:41.867458 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0438e3f8-e56c-41d8-b8ab-f1c6de52edb8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:41.867898 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0438e3f8-e56c-41d8-b8ab-f1c6de52edb8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:42.000932 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0438e3f8-e56c-41d8-b8ab-f1c6de52edb8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:42.009590 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0438e3f8-e56c-41d8-b8ab-f1c6de52edb8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:42.011104 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0438e3f8-e56c-41d8-b8ab-f1c6de52edb8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:42.012259 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0438e3f8-e56c-41d8-b8ab-f1c6de52edb8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.158042 Jul 28 06:41:42.012822 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 358/714] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:41 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:43.035730 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2b91fe3e-4f16-4ea1-85a4-59ebb5467108 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:43.036337 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2b91fe3e-4f16-4ea1-85a4-59ebb5467108 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:43.043103 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b91fe3e-4f16-4ea1-85a4-59ebb5467108 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:43.043561 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b91fe3e-4f16-4ea1-85a4-59ebb5467108 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:43.044334 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b91fe3e-4f16-4ea1-85a4-59ebb5467108 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:43.044773 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b91fe3e-4f16-4ea1-85a4-59ebb5467108 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:43.179093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2b91fe3e-4f16-4ea1-85a4-59ebb5467108 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:43.187737 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2b91fe3e-4f16-4ea1-85a4-59ebb5467108 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:43.189749 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2b91fe3e-4f16-4ea1-85a4-59ebb5467108 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:43.190914 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2b91fe3e-4f16-4ea1-85a4-59ebb5467108 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1807 microversion: 2.20 time: 0.159161 Jul 28 06:41:43.191462 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 357/715] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:43 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:41:44.214051 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c5fab12a-2724-4e98-977e-adf3e81573a9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:44.214588 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c5fab12a-2724-4e98-977e-adf3e81573a9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:44.221761 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c5fab12a-2724-4e98-977e-adf3e81573a9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:44.222211 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c5fab12a-2724-4e98-977e-adf3e81573a9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:44.222971 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c5fab12a-2724-4e98-977e-adf3e81573a9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:44.223408 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c5fab12a-2724-4e98-977e-adf3e81573a9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:44.353444 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c5fab12a-2724-4e98-977e-adf3e81573a9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:44.362039 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c5fab12a-2724-4e98-977e-adf3e81573a9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:44.363590 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c5fab12a-2724-4e98-977e-adf3e81573a9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:44.364761 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c5fab12a-2724-4e98-977e-adf3e81573a9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1794 microversion: 2.20 time: 0.154750 Jul 28 06:41:44.365346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 359/716] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:41:44 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:41:47.583183 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d92fa111-1f7e-475d-8cf6-9eed4facd4f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:47.587178 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d92fa111-1f7e-475d-8cf6-9eed4facd4f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:47.595965 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d92fa111-1f7e-475d-8cf6-9eed4facd4f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:47.595965 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d92fa111-1f7e-475d-8cf6-9eed4facd4f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:47.598444 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d92fa111-1f7e-475d-8cf6-9eed4facd4f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:47.599065 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d92fa111-1f7e-475d-8cf6-9eed4facd4f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:47.646437 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:47.676820 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d92fa111-1f7e-475d-8cf6-9eed4facd4f8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "POST /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/action" status: 202 len: 0 microversion: 2.1 time: 0.099285 Jul 28 06:41:47.677545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 358/717] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:41:47 2022] POST /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:41:47.685779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f64ced46-11b4-4b27-beb0-63b276c3d4fd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:47.686391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f64ced46-11b4-4b27-beb0-63b276c3d4fd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:47.694173 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f64ced46-11b4-4b27-beb0-63b276c3d4fd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:47.694613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f64ced46-11b4-4b27-beb0-63b276c3d4fd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:47.695397 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f64ced46-11b4-4b27-beb0-63b276c3d4fd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:47.695876 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f64ced46-11b4-4b27-beb0-63b276c3d4fd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:47.841532 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f64ced46-11b4-4b27-beb0-63b276c3d4fd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:47.849489 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f64ced46-11b4-4b27-beb0-63b276c3d4fd tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1750 microversion: 2.1 time: 0.167606 Jul 28 06:41:47.850047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 360/718] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:47 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:48.872018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-778090e4-cc8b-4fe4-b010-9f50e76ae68a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:48.872723 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-778090e4-cc8b-4fe4-b010-9f50e76ae68a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:48.878981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-778090e4-cc8b-4fe4-b010-9f50e76ae68a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:48.879435 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-778090e4-cc8b-4fe4-b010-9f50e76ae68a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:48.880210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-778090e4-cc8b-4fe4-b010-9f50e76ae68a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:48.880652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-778090e4-cc8b-4fe4-b010-9f50e76ae68a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:49.025787 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-778090e4-cc8b-4fe4-b010-9f50e76ae68a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:49.033906 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-778090e4-cc8b-4fe4-b010-9f50e76ae68a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1750 microversion: 2.1 time: 0.166632 Jul 28 06:41:49.034484 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 359/719] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:48 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:41:50.055187 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-80329143-84a2-4ecf-b7a7-8d3c7b328be7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:50.055803 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-80329143-84a2-4ecf-b7a7-8d3c7b328be7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:50.062038 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-80329143-84a2-4ecf-b7a7-8d3c7b328be7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:50.062493 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-80329143-84a2-4ecf-b7a7-8d3c7b328be7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:50.063263 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-80329143-84a2-4ecf-b7a7-8d3c7b328be7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:50.063701 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-80329143-84a2-4ecf-b7a7-8d3c7b328be7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:50.212851 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-80329143-84a2-4ecf-b7a7-8d3c7b328be7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:50.220836 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-80329143-84a2-4ecf-b7a7-8d3c7b328be7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.169534 Jul 28 06:41:50.221428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 361/720] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:50 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:51.242869 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d832d39e-94ea-4863-bcf8-24fb5e194864 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:51.243468 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d832d39e-94ea-4863-bcf8-24fb5e194864 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:51.246005 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:51.251660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d832d39e-94ea-4863-bcf8-24fb5e194864 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:51.252106 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d832d39e-94ea-4863-bcf8-24fb5e194864 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:51.252894 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d832d39e-94ea-4863-bcf8-24fb5e194864 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:51.253345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d832d39e-94ea-4863-bcf8-24fb5e194864 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:51.399421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d832d39e-94ea-4863-bcf8-24fb5e194864 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:51.407332 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d832d39e-94ea-4863-bcf8-24fb5e194864 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.168264 Jul 28 06:41:51.408171 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 360/721] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:51 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:52.429552 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f762e586-0f30-4734-90d7-d3ef5b3321bf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:52.430571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f762e586-0f30-4734-90d7-d3ef5b3321bf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:52.436793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f762e586-0f30-4734-90d7-d3ef5b3321bf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:52.437235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f762e586-0f30-4734-90d7-d3ef5b3321bf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:52.438020 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f762e586-0f30-4734-90d7-d3ef5b3321bf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:52.438447 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f762e586-0f30-4734-90d7-d3ef5b3321bf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:52.591575 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f762e586-0f30-4734-90d7-d3ef5b3321bf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:52.600224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f762e586-0f30-4734-90d7-d3ef5b3321bf tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.174516 Jul 28 06:41:52.600928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 362/722] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:52 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:53.621777 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-82a61190-36c5-4283-b8d1-506de31e33bb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:53.622296 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-82a61190-36c5-4283-b8d1-506de31e33bb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:53.628873 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-82a61190-36c5-4283-b8d1-506de31e33bb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:53.629342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-82a61190-36c5-4283-b8d1-506de31e33bb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:53.630112 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-82a61190-36c5-4283-b8d1-506de31e33bb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:53.630551 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-82a61190-36c5-4283-b8d1-506de31e33bb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:53.774323 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-82a61190-36c5-4283-b8d1-506de31e33bb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:53.782253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-82a61190-36c5-4283-b8d1-506de31e33bb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.164440 Jul 28 06:41:53.783564 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 361/723] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:53 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:54.805061 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7ff3f24a-8e22-41c4-8b9b-848e5087cecb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:54.805735 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7ff3f24a-8e22-41c4-8b9b-848e5087cecb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:54.812327 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ff3f24a-8e22-41c4-8b9b-848e5087cecb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:54.812777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ff3f24a-8e22-41c4-8b9b-848e5087cecb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:54.813567 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ff3f24a-8e22-41c4-8b9b-848e5087cecb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:54.814825 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ff3f24a-8e22-41c4-8b9b-848e5087cecb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:54.961826 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7ff3f24a-8e22-41c4-8b9b-848e5087cecb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:54.969724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7ff3f24a-8e22-41c4-8b9b-848e5087cecb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.168515 Jul 28 06:41:54.970342 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 363/724] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:54 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:55.991233 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-88cefce5-70cb-4c2d-8bc9-0cc5a904ac9f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:55.991916 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-88cefce5-70cb-4c2d-8bc9-0cc5a904ac9f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:55.998611 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-88cefce5-70cb-4c2d-8bc9-0cc5a904ac9f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:55.999066 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-88cefce5-70cb-4c2d-8bc9-0cc5a904ac9f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:55.999828 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-88cefce5-70cb-4c2d-8bc9-0cc5a904ac9f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:56.000268 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-88cefce5-70cb-4c2d-8bc9-0cc5a904ac9f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:56.145147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-88cefce5-70cb-4c2d-8bc9-0cc5a904ac9f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:56.153178 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-88cefce5-70cb-4c2d-8bc9-0cc5a904ac9f tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.165825 Jul 28 06:41:56.153774 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 362/725] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:55 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:57.174186 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b80d5ab6-c83f-4ecb-be11-051603afdf4d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:57.174814 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b80d5ab6-c83f-4ecb-be11-051603afdf4d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:57.181203 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b80d5ab6-c83f-4ecb-be11-051603afdf4d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:57.181672 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b80d5ab6-c83f-4ecb-be11-051603afdf4d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:57.182418 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b80d5ab6-c83f-4ecb-be11-051603afdf4d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:57.182848 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b80d5ab6-c83f-4ecb-be11-051603afdf4d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:57.326460 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b80d5ab6-c83f-4ecb-be11-051603afdf4d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:57.335152 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b80d5ab6-c83f-4ecb-be11-051603afdf4d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.165039 Jul 28 06:41:57.335723 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 364/726] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:57 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:58.357652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d9da680a-9151-4ca6-aeb1-f8caee372702 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:58.358266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d9da680a-9151-4ca6-aeb1-f8caee372702 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:58.364765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9da680a-9151-4ca6-aeb1-f8caee372702 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:58.365213 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9da680a-9151-4ca6-aeb1-f8caee372702 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:58.366009 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9da680a-9151-4ca6-aeb1-f8caee372702 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:58.366447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9da680a-9151-4ca6-aeb1-f8caee372702 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:58.509607 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d9da680a-9151-4ca6-aeb1-f8caee372702 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:58.517697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d9da680a-9151-4ca6-aeb1-f8caee372702 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.164069 Jul 28 06:41:58.518237 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 363/727] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:58 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:59.540802 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-618a54b3-c15f-4947-ad3f-68e80cd75c75 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:59.541443 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-618a54b3-c15f-4947-ad3f-68e80cd75c75 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:59.543912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=36 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:59.548899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-618a54b3-c15f-4947-ad3f-68e80cd75c75 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:59.549384 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-618a54b3-c15f-4947-ad3f-68e80cd75c75 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:59.550274 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-618a54b3-c15f-4947-ad3f-68e80cd75c75 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:59.550718 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-618a54b3-c15f-4947-ad3f-68e80cd75c75 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:59.696574 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-618a54b3-c15f-4947-ad3f-68e80cd75c75 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:59.704550 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-618a54b3-c15f-4947-ad3f-68e80cd75c75 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.168522 Jul 28 06:41:59.705670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 365/728] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:59 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:00.725898 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f8b75e33-df4d-4a7d-9427-edef8cbcd004 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:00.726584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f8b75e33-df4d-4a7d-9427-edef8cbcd004 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:00.732979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f8b75e33-df4d-4a7d-9427-edef8cbcd004 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:00.733454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f8b75e33-df4d-4a7d-9427-edef8cbcd004 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:00.734236 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f8b75e33-df4d-4a7d-9427-edef8cbcd004 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:00.734692 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f8b75e33-df4d-4a7d-9427-edef8cbcd004 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:00.877632 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f8b75e33-df4d-4a7d-9427-edef8cbcd004 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:00.885522 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f8b75e33-df4d-4a7d-9427-edef8cbcd004 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.163464 Jul 28 06:42:00.886087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 364/729] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:00 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:01.906576 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-de29c43d-1450-4b78-a149-4182e1b4732c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:01.907218 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-de29c43d-1450-4b78-a149-4182e1b4732c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:01.914627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de29c43d-1450-4b78-a149-4182e1b4732c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:01.915074 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de29c43d-1450-4b78-a149-4182e1b4732c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:01.915846 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de29c43d-1450-4b78-a149-4182e1b4732c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:01.916284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de29c43d-1450-4b78-a149-4182e1b4732c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:01.918972 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=94 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:02.027953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-77b066e4-b815-46ff-aab8-9fdd46eed436 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:02.028720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-77b066e4-b815-46ff-aab8-9fdd46eed436 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:02.035467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77b066e4-b815-46ff-aab8-9fdd46eed436 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:02.036181 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77b066e4-b815-46ff-aab8-9fdd46eed436 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:02.036952 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77b066e4-b815-46ff-aab8-9fdd46eed436 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:02.037573 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77b066e4-b815-46ff-aab8-9fdd46eed436 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:02.067436 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-de29c43d-1450-4b78-a149-4182e1b4732c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:02.075784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-de29c43d-1450-4b78-a149-4182e1b4732c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.173084 Jul 28 06:42:02.076345 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 366/730] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:01 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:02.181416 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-77b066e4-b815-46ff-aab8-9fdd46eed436 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lazy-loading 'services' on Instance uuid 9e6b8321-acd0-40c7-ac20-a016af964766 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:42:02.296120 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-77b066e4-b815-46ff-aab8-9fdd46eed436 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766/os-volume_attachments/205b2a8b-dd85-4dab-935f-a57c8d816993" status: 202 len: 0 microversion: 2.1 time: 0.272006 Jul 28 06:42:02.296821 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 365/731] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:42:02 2022] DELETE /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766/os-volume_attachments/205b2a8b-dd85-4dab-935f-a57c8d816993 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:42:03.104221 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3337c19b-3aeb-4197-ac8c-e8b0411a07a5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:03.105407 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3337c19b-3aeb-4197-ac8c-e8b0411a07a5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:03.117131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3337c19b-3aeb-4197-ac8c-e8b0411a07a5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:03.117864 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3337c19b-3aeb-4197-ac8c-e8b0411a07a5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:03.118689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3337c19b-3aeb-4197-ac8c-e8b0411a07a5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:03.119406 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3337c19b-3aeb-4197-ac8c-e8b0411a07a5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:03.272987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3337c19b-3aeb-4197-ac8c-e8b0411a07a5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:03.280855 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3337c19b-3aeb-4197-ac8c-e8b0411a07a5 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.184324 Jul 28 06:42:03.281445 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 367/732] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:03 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:04.303846 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-139d4b37-5aa2-4899-bad0-3852eb70f2dc tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:04.304577 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-139d4b37-5aa2-4899-bad0-3852eb70f2dc tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:04.310869 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-139d4b37-5aa2-4899-bad0-3852eb70f2dc tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:04.311323 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-139d4b37-5aa2-4899-bad0-3852eb70f2dc tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:04.312080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-139d4b37-5aa2-4899-bad0-3852eb70f2dc tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:04.312524 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-139d4b37-5aa2-4899-bad0-3852eb70f2dc tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:04.460966 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-139d4b37-5aa2-4899-bad0-3852eb70f2dc tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:04.469273 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-139d4b37-5aa2-4899-bad0-3852eb70f2dc tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.170223 Jul 28 06:42:04.469877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 366/733] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:04 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:05.491382 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-91e1f1c2-ea7a-482b-a5e9-d2ebd3e1c75b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:05.491998 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-91e1f1c2-ea7a-482b-a5e9-d2ebd3e1c75b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:05.498122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91e1f1c2-ea7a-482b-a5e9-d2ebd3e1c75b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:05.498634 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91e1f1c2-ea7a-482b-a5e9-d2ebd3e1c75b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:05.499391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91e1f1c2-ea7a-482b-a5e9-d2ebd3e1c75b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:05.499820 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-91e1f1c2-ea7a-482b-a5e9-d2ebd3e1c75b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:05.539550 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b30aba2d-58ba-4ae3-ba6e-3c9fd4126697 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:05.540078 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b30aba2d-58ba-4ae3-ba6e-3c9fd4126697 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:05.546631 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b30aba2d-58ba-4ae3-ba6e-3c9fd4126697 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:05.547078 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b30aba2d-58ba-4ae3-ba6e-3c9fd4126697 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:05.547845 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b30aba2d-58ba-4ae3-ba6e-3c9fd4126697 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:05.548270 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b30aba2d-58ba-4ae3-ba6e-3c9fd4126697 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:05.574324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b30aba2d-58ba-4ae3-ba6e-3c9fd4126697 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Going to try to terminate instance {{(pid=124563) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:42:05.652076 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b30aba2d-58ba-4ae3-ba6e-3c9fd4126697 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 204 len: 0 microversion: 2.1 time: 0.116020 Jul 28 06:42:05.652673 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 367/734] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:42:05 2022] DELETE /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 06:42:05.657194 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-91e1f1c2-ea7a-482b-a5e9-d2ebd3e1c75b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:05.661572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f3c77b53-4b1f-4daa-9bcf-584ddd0b4865 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:05.662281 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f3c77b53-4b1f-4daa-9bcf-584ddd0b4865 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:05.666326 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-91e1f1c2-ea7a-482b-a5e9-d2ebd3e1c75b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.179289 Jul 28 06:42:05.668711 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f3c77b53-4b1f-4daa-9bcf-584ddd0b4865 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:05.668711 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f3c77b53-4b1f-4daa-9bcf-584ddd0b4865 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:05.669347 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 368/735] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:05 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:05.669481 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f3c77b53-4b1f-4daa-9bcf-584ddd0b4865 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:05.669817 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f3c77b53-4b1f-4daa-9bcf-584ddd0b4865 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:05.804677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f3c77b53-4b1f-4daa-9bcf-584ddd0b4865 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:05.812118 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f3c77b53-4b1f-4daa-9bcf-584ddd0b4865 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1512 microversion: 2.1 time: 0.155015 Jul 28 06:42:05.812677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 368/736] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:05 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:05.894114 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b26a4c86-ac28-4c57-9446-b2de77e81be5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:05.894849 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b26a4c86-ac28-4c57-9446-b2de77e81be5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:05.901619 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b26a4c86-ac28-4c57-9446-b2de77e81be5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:05.902064 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b26a4c86-ac28-4c57-9446-b2de77e81be5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:05.903170 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b26a4c86-ac28-4c57-9446-b2de77e81be5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:05.903791 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b26a4c86-ac28-4c57-9446-b2de77e81be5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:05.935284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b26a4c86-ac28-4c57-9446-b2de77e81be5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840/ips" status: 200 len: 149 microversion: 2.1 time: 0.046276 Jul 28 06:42:05.935855 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 369/737] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Jul 28 06:42:05 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:05.950644 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-86dd7eb1-2bba-4ddf-aa24-f2b195d51aa5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76b18e9c-774a-4ca2-8ea8-91af9149c017"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:05.953034 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-86dd7eb1-2bba-4ddf-aa24-f2b195d51aa5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:05.959700 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-86dd7eb1-2bba-4ddf-aa24-f2b195d51aa5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:05.960149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-86dd7eb1-2bba-4ddf-aa24-f2b195d51aa5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:05.960916 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-86dd7eb1-2bba-4ddf-aa24-f2b195d51aa5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:05.961367 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-86dd7eb1-2bba-4ddf-aa24-f2b195d51aa5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:06.039797 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-86dd7eb1-2bba-4ddf-aa24-f2b195d51aa5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Invalid volume: volume 76b18e9c-774a-4ca2-8ea8-91af9149c017 is already attached to instances: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-86dd7eb1-2bba-4ddf-aa24-f2b195d51aa5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: POST /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840/os-volume_attachments HTTP/1.1 Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 74 Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:42:06.041559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {"volumeAttachment": {"volumeId": "76b18e9c-774a-4ca2-8ea8-91af9149c017"}} Jul 28 06:42:06.043239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Invalid volume: volume 76b18e9c-774a-4ca2-8ea8-91af9149c017 is already attached to instances: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'server_id': 'b7df248c-2b87-417e-b113-ecce4d8c0840', 'body': {'volumeAttachment': {'volumeId': '76b18e9c-774a-4ca2-8ea8-91af9149c017'}}} Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 76b18e9c-774a-4ca2-8ea8-91af9149c017 is already attached to instances: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:06.044211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 76b18e9c-774a-4ca2-8ea8-91af9149c017 is already attached to instances: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:06.045646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:06.046884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:06.046884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:42:06.046884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:42:06.046884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 76b18e9c-774a-4ca2-8ea8-91af9149c017 is already attached to instances: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 Jul 28 06:42:06.046884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:06.046884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-86dd7eb1-2bba-4ddf-aa24-f2b195d51aa5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 400 to user: Invalid volume: volume 76b18e9c-774a-4ca2-8ea8-91af9149c017 is already attached to instances: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:42:06.046884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-86dd7eb1-2bba-4ddf-aa24-f2b195d51aa5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096281 Jul 28 06:42:06.046884 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 369/738] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:42:05 2022] POST /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:42:06.052788 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-073b9133-8083-48e3-b858-e1be89ddebf6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:06.053277 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-073b9133-8083-48e3-b858-e1be89ddebf6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:06.059243 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-073b9133-8083-48e3-b858-e1be89ddebf6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:06.059685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-073b9133-8083-48e3-b858-e1be89ddebf6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:06.060462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-073b9133-8083-48e3-b858-e1be89ddebf6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:06.060892 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-073b9133-8083-48e3-b858-e1be89ddebf6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:06.085722 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-073b9133-8083-48e3-b858-e1be89ddebf6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:42:06.160608 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-073b9133-8083-48e3-b858-e1be89ddebf6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 204 len: 0 microversion: 2.1 time: 0.111971 Jul 28 06:42:06.169642 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 370/739] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:42:06 2022] DELETE /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:42:06.178288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-655a7c49-26d7-4854-a8af-587d83416359 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:06.178930 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-655a7c49-26d7-4854-a8af-587d83416359 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:06.186024 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-655a7c49-26d7-4854-a8af-587d83416359 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:06.186468 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-655a7c49-26d7-4854-a8af-587d83416359 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:06.187298 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-655a7c49-26d7-4854-a8af-587d83416359 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:06.187683 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-655a7c49-26d7-4854-a8af-587d83416359 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:06.321798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-655a7c49-26d7-4854-a8af-587d83416359 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:06.329118 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-655a7c49-26d7-4854-a8af-587d83416359 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1681 microversion: 2.1 time: 0.155228 Jul 28 06:42:06.329696 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 370/740] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:06 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:06.689572 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-014b998e-92f3-42ed-add8-32ed69245738 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:06.690195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-014b998e-92f3-42ed-add8-32ed69245738 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:06.697667 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-014b998e-92f3-42ed-add8-32ed69245738 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:06.698110 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-014b998e-92f3-42ed-add8-32ed69245738 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:06.698861 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-014b998e-92f3-42ed-add8-32ed69245738 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:06.699288 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-014b998e-92f3-42ed-add8-32ed69245738 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:06.840058 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6569840d-70b0-42f0-8807-3774540e7fd8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:06.840669 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6569840d-70b0-42f0-8807-3774540e7fd8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:06.840884 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-014b998e-92f3-42ed-add8-32ed69245738 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:06.847268 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6569840d-70b0-42f0-8807-3774540e7fd8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:06.847754 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6569840d-70b0-42f0-8807-3774540e7fd8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:06.849154 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6569840d-70b0-42f0-8807-3774540e7fd8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:06.849443 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-014b998e-92f3-42ed-add8-32ed69245738 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.163594 Jul 28 06:42:06.849657 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6569840d-70b0-42f0-8807-3774540e7fd8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:06.853697 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 371/741] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:06 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:07.086272 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6569840d-70b0-42f0-8807-3774540e7fd8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:07.093722 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6569840d-70b0-42f0-8807-3774540e7fd8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1512 microversion: 2.1 time: 0.257595 Jul 28 06:42:07.094274 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 371/742] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:06 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:07.351220 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d3f1e343-20eb-485d-8497-5ecd4155a8e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:07.351750 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d3f1e343-20eb-485d-8497-5ecd4155a8e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:07.357832 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d3f1e343-20eb-485d-8497-5ecd4155a8e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:07.358284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d3f1e343-20eb-485d-8497-5ecd4155a8e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:07.359047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d3f1e343-20eb-485d-8497-5ecd4155a8e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:07.359486 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d3f1e343-20eb-485d-8497-5ecd4155a8e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:07.727959 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d3f1e343-20eb-485d-8497-5ecd4155a8e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:07.736420 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d3f1e343-20eb-485d-8497-5ecd4155a8e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1681 microversion: 2.1 time: 0.389214 Jul 28 06:42:07.736992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 372/743] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:07 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1681 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:07.870694 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a5ded2b9-fbd1-41e3-a89e-8751a17d49c8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:07.871311 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a5ded2b9-fbd1-41e3-a89e-8751a17d49c8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:07.878509 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a5ded2b9-fbd1-41e3-a89e-8751a17d49c8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:07.879041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a5ded2b9-fbd1-41e3-a89e-8751a17d49c8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:07.879800 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a5ded2b9-fbd1-41e3-a89e-8751a17d49c8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:07.880238 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a5ded2b9-fbd1-41e3-a89e-8751a17d49c8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:07.895368 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:08.026656 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a5ded2b9-fbd1-41e3-a89e-8751a17d49c8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:08.034733 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a5ded2b9-fbd1-41e3-a89e-8751a17d49c8 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.167912 Jul 28 06:42:08.035299 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 372/744] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:07 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:08.114824 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6afc527b-1219-4f7b-8b95-ca2aa79245e7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:08.115456 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6afc527b-1219-4f7b-8b95-ca2aa79245e7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:08.121360 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6afc527b-1219-4f7b-8b95-ca2aa79245e7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:08.121806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6afc527b-1219-4f7b-8b95-ca2aa79245e7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:08.122557 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6afc527b-1219-4f7b-8b95-ca2aa79245e7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:08.122981 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6afc527b-1219-4f7b-8b95-ca2aa79245e7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:08.256007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6afc527b-1219-4f7b-8b95-ca2aa79245e7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:08.263398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6afc527b-1219-4f7b-8b95-ca2aa79245e7 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1512 microversion: 2.1 time: 0.152557 Jul 28 06:42:08.263965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 373/745] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:08 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:08.758141 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-789a9bb5-f179-44a4-8188-6a317c0c8cc5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:08.758757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-789a9bb5-f179-44a4-8188-6a317c0c8cc5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:08.764799 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-789a9bb5-f179-44a4-8188-6a317c0c8cc5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:08.765241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-789a9bb5-f179-44a4-8188-6a317c0c8cc5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:08.766039 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-789a9bb5-f179-44a4-8188-6a317c0c8cc5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:08.766473 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-789a9bb5-f179-44a4-8188-6a317c0c8cc5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:08.903366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-789a9bb5-f179-44a4-8188-6a317c0c8cc5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:08.912153 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-789a9bb5-f179-44a4-8188-6a317c0c8cc5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1681 microversion: 2.1 time: 0.157899 Jul 28 06:42:08.912725 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 373/746] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:08 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:09.056413 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e29e53ee-15db-455a-b39b-907240d990d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:09.056945 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e29e53ee-15db-455a-b39b-907240d990d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:09.063450 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e29e53ee-15db-455a-b39b-907240d990d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:09.063896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e29e53ee-15db-455a-b39b-907240d990d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:09.064653 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e29e53ee-15db-455a-b39b-907240d990d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:09.065086 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e29e53ee-15db-455a-b39b-907240d990d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:09.219178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e29e53ee-15db-455a-b39b-907240d990d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:09.228537 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e29e53ee-15db-455a-b39b-907240d990d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.176129 Jul 28 06:42:09.229099 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 374/747] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:09 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:09.285874 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-df5b83c2-d5a7-438b-a893-f46383c669c9 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:09.286489 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-df5b83c2-d5a7-438b-a893-f46383c669c9 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:09.292524 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df5b83c2-d5a7-438b-a893-f46383c669c9 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:09.292990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df5b83c2-d5a7-438b-a893-f46383c669c9 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:09.293773 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df5b83c2-d5a7-438b-a893-f46383c669c9 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:09.294208 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df5b83c2-d5a7-438b-a893-f46383c669c9 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:09.432369 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-df5b83c2-d5a7-438b-a893-f46383c669c9 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:09.439855 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-df5b83c2-d5a7-438b-a893-f46383c669c9 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1512 microversion: 2.1 time: 0.158554 Jul 28 06:42:09.440939 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 374/748] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:09 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:09.934895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2933f10e-b800-4904-a159-6e87334dc96b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:09.935497 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2933f10e-b800-4904-a159-6e87334dc96b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:09.942250 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2933f10e-b800-4904-a159-6e87334dc96b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:09.942945 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2933f10e-b800-4904-a159-6e87334dc96b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:09.943693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2933f10e-b800-4904-a159-6e87334dc96b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:09.944120 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2933f10e-b800-4904-a159-6e87334dc96b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:10.123567 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2933f10e-b800-4904-a159-6e87334dc96b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:10.131448 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2933f10e-b800-4904-a159-6e87334dc96b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1681 microversion: 2.1 time: 0.200415 Jul 28 06:42:10.132007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 375/749] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:09 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:10.249932 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-59bce95b-0d24-4d7f-ba8b-cd5700ed6a7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:10.250546 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-59bce95b-0d24-4d7f-ba8b-cd5700ed6a7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:10.257510 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59bce95b-0d24-4d7f-ba8b-cd5700ed6a7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:10.257964 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59bce95b-0d24-4d7f-ba8b-cd5700ed6a7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:10.258722 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59bce95b-0d24-4d7f-ba8b-cd5700ed6a7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:10.259161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-59bce95b-0d24-4d7f-ba8b-cd5700ed6a7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:10.404537 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-59bce95b-0d24-4d7f-ba8b-cd5700ed6a7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:10.412527 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-59bce95b-0d24-4d7f-ba8b-cd5700ed6a7e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.166358 Jul 28 06:42:10.413085 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 375/750] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:10 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:10.461613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-dc60a218-10e8-4c38-87c3-c9b712955252 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:10.462227 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-dc60a218-10e8-4c38-87c3-c9b712955252 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:10.468252 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dc60a218-10e8-4c38-87c3-c9b712955252 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:10.468705 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dc60a218-10e8-4c38-87c3-c9b712955252 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:10.469503 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dc60a218-10e8-4c38-87c3-c9b712955252 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:10.469943 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-dc60a218-10e8-4c38-87c3-c9b712955252 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:10.604330 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-dc60a218-10e8-4c38-87c3-c9b712955252 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:10.611724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-dc60a218-10e8-4c38-87c3-c9b712955252 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1512 microversion: 2.1 time: 0.153999 Jul 28 06:42:10.612844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 376/751] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:10 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:11.153497 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1a43a3f1-b4fa-4fdf-8e75-10c7e12bc018 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:11.154649 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1a43a3f1-b4fa-4fdf-8e75-10c7e12bc018 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:11.161375 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1a43a3f1-b4fa-4fdf-8e75-10c7e12bc018 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:11.161834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1a43a3f1-b4fa-4fdf-8e75-10c7e12bc018 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:11.162619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1a43a3f1-b4fa-4fdf-8e75-10c7e12bc018 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:11.163061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1a43a3f1-b4fa-4fdf-8e75-10c7e12bc018 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:11.326034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-4940ac13-4ad1-46d8-91c0-0f0d2fa68d1e req-5704de76-8477-4a4c-944d-db4eafa177c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6b8321-acd0-40c7-ac20-a016af964766", "name": "network-vif-deleted", "tag": "d5ab285a-d02e-4ade-81d1-f6bd40c669f7"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:11.340170 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-4940ac13-4ad1-46d8-91c0-0f0d2fa68d1e req-5704de76-8477-4a4c-944d-db4eafa177c5 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:11.340603 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-4940ac13-4ad1-46d8-91c0-0f0d2fa68d1e req-5704de76-8477-4a4c-944d-db4eafa177c5 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:11.353824 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-4940ac13-4ad1-46d8-91c0-0f0d2fa68d1e req-5704de76-8477-4a4c-944d-db4eafa177c5 service nova] Creating event network-vif-deleted:d5ab285a-d02e-4ade-81d1-f6bd40c669f7 for instance 9e6b8321-acd0-40c7-ac20-a016af964766 on hv-cinder-85060 Jul 28 06:42:11.359636 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-4940ac13-4ad1-46d8-91c0-0f0d2fa68d1e req-5704de76-8477-4a4c-944d-db4eafa177c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037498 Jul 28 06:42:11.360928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 377/752] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:11.372703 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1a43a3f1-b4fa-4fdf-8e75-10c7e12bc018 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:11.380843 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1a43a3f1-b4fa-4fdf-8e75-10c7e12bc018 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1681 microversion: 2.1 time: 0.231252 Jul 28 06:42:11.381878 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 376/753] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:11 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:11.435232 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c74e568c-01d4-4f6e-b2e4-153a19726de6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:11.436187 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c74e568c-01d4-4f6e-b2e4-153a19726de6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:11.444874 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c74e568c-01d4-4f6e-b2e4-153a19726de6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:11.445678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c74e568c-01d4-4f6e-b2e4-153a19726de6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:11.446467 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c74e568c-01d4-4f6e-b2e4-153a19726de6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:11.446992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c74e568c-01d4-4f6e-b2e4-153a19726de6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:11.633670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:11.634345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:11.642212 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:11.642668 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:11.644025 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:11.644537 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:11.675834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:11.676310 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:11.676763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lazy-loading 'fault' on Instance uuid 9e6b8321-acd0-40c7-ac20-a016af964766 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:42:11.721669 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9f183ac716439aab70e789f9561901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafc15c173f94f8eb804e56a2d4673a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:11.726607 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c74e568c-01d4-4f6e-b2e4-153a19726de6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:11.730818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-fece1d6c-0365-4b95-8798-da2b8ab0d892 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 200 len: 1308 microversion: 2.1 time: 0.101250 Jul 28 06:42:11.731409 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 377/754] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:11 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:11.738468 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c74e568c-01d4-4f6e-b2e4-153a19726de6 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.307771 Jul 28 06:42:11.739043 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 378/755] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:11 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:11.889966 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-b324fa4c-59ac-4c9a-a1aa-4fca35e2130a req-a4bce785-7527-4138-a919-1316ab7b0a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7df248c-2b87-417e-b113-ecce4d8c0840", "name": "network-vif-deleted", "tag": "e2fc8e5d-c2ef-4ebe-97f9-f660cc1fec0a"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:11.900993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-b324fa4c-59ac-4c9a-a1aa-4fca35e2130a req-a4bce785-7527-4138-a919-1316ab7b0a9b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:11.901485 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-b324fa4c-59ac-4c9a-a1aa-4fca35e2130a req-a4bce785-7527-4138-a919-1316ab7b0a9b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:11.914354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-b324fa4c-59ac-4c9a-a1aa-4fca35e2130a req-a4bce785-7527-4138-a919-1316ab7b0a9b service nova] Creating event network-vif-deleted:e2fc8e5d-c2ef-4ebe-97f9-f660cc1fec0a for instance b7df248c-2b87-417e-b113-ecce4d8c0840 on hv-cinder-85060 Jul 28 06:42:11.930128 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-b324fa4c-59ac-4c9a-a1aa-4fca35e2130a req-a4bce785-7527-4138-a919-1316ab7b0a9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044650 Jul 28 06:42:11.931729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 378/756] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:12.403300 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:12.404081 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:12.411250 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:12.411784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:12.412474 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:12.412915 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:12.447015 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:12.447729 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:12.448600 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lazy-loading 'fault' on Instance uuid b7df248c-2b87-417e-b113-ecce4d8c0840 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:42:12.499988 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:12.510053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-69d936cf-7e4a-450c-93d8-4079fcd22e62 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 200 len: 1331 microversion: 2.1 time: 0.110542 Jul 28 06:42:12.511075 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 379/757] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:12 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:12.752312 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9fe590e1-f65a-4ecb-b5a0-f311988a3dc8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:12.753581 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9fe590e1-f65a-4ecb-b5a0-f311988a3dc8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] [instance: 9e6b8321-acd0-40c7-ac20-a016af964766] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:12.759993 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2d3b1a0e-c37b-4967-91d7-d34eecf6e0c1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:12.760592 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2d3b1a0e-c37b-4967-91d7-d34eecf6e0c1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:12.760995 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9fe590e1-f65a-4ecb-b5a0-f311988a3dc8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:12.761580 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9fe590e1-f65a-4ecb-b5a0-f311988a3dc8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:12.762412 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9fe590e1-f65a-4ecb-b5a0-f311988a3dc8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:12.763046 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9fe590e1-f65a-4ecb-b5a0-f311988a3dc8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:12.766892 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d3b1a0e-c37b-4967-91d7-d34eecf6e0c1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:12.767546 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d3b1a0e-c37b-4967-91d7-d34eecf6e0c1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:12.769167 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d3b1a0e-c37b-4967-91d7-d34eecf6e0c1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:12.770555 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d3b1a0e-c37b-4967-91d7-d34eecf6e0c1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:12.779370 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-9fe590e1-f65a-4ecb-b5a0-f311988a3dc8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] HTTP exception thrown: Instance 9e6b8321-acd0-40c7-ac20-a016af964766 could not be found. Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9fe590e1-f65a-4ecb-b5a0-f311988a3dc8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Request method failure captured: Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 HTTP/1.1 Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i8ZFjWdB5nIf16_Rd6c0QpOmRcEtRSkEme8rbkvle3C4dWZKqkRLbArETvhmWBL7nsNvMCBJSkOOTgtkVNQ8G5z4UFrwvSc4dMw9kZvFX5nhHc6ibW9zAJSTCHMyU2HC_5iPlyQrJ7Oq7RIA4D4EXJefhHTOI7Wp2qhrDiJPuLue2I Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: bafc15c173f94f8eb804e56a2d4673a8 Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-VolumesSnapshotTestJSON-124019393 Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:42:12.781478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bafc15c173f94f8eb804e56a2d4673a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bafc15c173f94f8eb804e56a2d4673a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bafc15c173f94f8eb804e56a2d4673a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bafc15c173f94f8eb804e56a2d4673a8"}]}] Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-VolumesSnapshotTestJSON-124019393 Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: bafc15c173f94f8eb804e56a2d4673a8 Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-124019393 Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-VolumesSnapshotTestJSON-124019393-project Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: bb9f183ac716439aab70e789f9561901 Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-VolumesSnapshotTestJSON-124019393-project Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 9e6b8321-acd0-40c7-ac20-a016af964766 could not be found. Jul 28 06:42:12.783087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '9e6b8321-acd0-40c7-ac20-a016af964766'} Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6b8321-acd0-40c7-ac20-a016af964766 could not be found. Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:42:12.785366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6b8321-acd0-40c7-ac20-a016af964766 could not be found. Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6b8321-acd0-40c7-ac20-a016af964766 could not be found. Jul 28 06:42:12.786829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:12.788134 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9fe590e1-f65a-4ecb-b5a0-f311988a3dc8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] Returning 404 to user: Instance 9e6b8321-acd0-40c7-ac20-a016af964766 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:42:12.788134 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9fe590e1-f65a-4ecb-b5a0-f311988a3dc8 tempest-VolumesSnapshotTestJSON-124019393 tempest-VolumesSnapshotTestJSON-124019393-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766" status: 404 len: 111 microversion: 2.1 time: 0.037476 Jul 28 06:42:12.788308 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 379/758] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:12 2022] GET /compute/v2.1/servers/9e6b8321-acd0-40c7-ac20-a016af964766 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:42:12.963142 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2d3b1a0e-c37b-4967-91d7-d34eecf6e0c1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:12.974616 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2d3b1a0e-c37b-4967-91d7-d34eecf6e0c1 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.218278 Jul 28 06:42:12.975862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 380/759] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:12 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:13.531844 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d8263155-c29b-4d6e-8bea-97d3a5062a4c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:13.532480 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d8263155-c29b-4d6e-8bea-97d3a5062a4c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:13.539416 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d8263155-c29b-4d6e-8bea-97d3a5062a4c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:13.539874 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d8263155-c29b-4d6e-8bea-97d3a5062a4c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:13.540682 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d8263155-c29b-4d6e-8bea-97d3a5062a4c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:13.541122 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d8263155-c29b-4d6e-8bea-97d3a5062a4c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:13.554960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-d8263155-c29b-4d6e-8bea-97d3a5062a4c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d8263155-c29b-4d6e-8bea-97d3a5062a4c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 HTTP/1.1 Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:42:13.556469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:42:13.558043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': 'b7df248c-2b87-417e-b113-ecce4d8c0840'} Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:42:13.558950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:42:13.560392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:13.562018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d8263155-c29b-4d6e-8bea-97d3a5062a4c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:42:13.562018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d8263155-c29b-4d6e-8bea-97d3a5062a4c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 404 len: 111 microversion: 2.1 time: 0.029987 Jul 28 06:42:13.562018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 380/760] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:13 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:42:13.567260 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7c71131c-646f-4017-9bfd-e88cca887288 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '.version_select at 0x7f57476bddc0>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:13.588668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7c71131c-646f-4017-9bfd-e88cca887288 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496733716" status: 202 len: 0 microversion: 2.1 time: 0.025191 Jul 28 06:42:13.589577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 381/761] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Jul 28 06:42:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496733716 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:42:13.999299 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4014e89c-6a02-496a-b3f8-4011f8d40011 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:14.000071 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4014e89c-6a02-496a-b3f8-4011f8d40011 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:14.007233 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4014e89c-6a02-496a-b3f8-4011f8d40011 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:14.007687 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4014e89c-6a02-496a-b3f8-4011f8d40011 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:14.008463 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4014e89c-6a02-496a-b3f8-4011f8d40011 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:14.008898 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4014e89c-6a02-496a-b3f8-4011f8d40011 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:14.213741 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4014e89c-6a02-496a-b3f8-4011f8d40011 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:14.223472 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4014e89c-6a02-496a-b3f8-4011f8d40011 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1755 microversion: 2.1 time: 0.228717 Jul 28 06:42:14.242017 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 381/762] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:13 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1755 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:14.446722 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e5727100-45c2-458b-97b3-958bf50aae20 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:14.447492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e5727100-45c2-458b-97b3-958bf50aae20 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:14.455220 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e5727100-45c2-458b-97b3-958bf50aae20 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:14.455619 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e5727100-45c2-458b-97b3-958bf50aae20 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:14.456623 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e5727100-45c2-458b-97b3-958bf50aae20 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:14.457322 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e5727100-45c2-458b-97b3-958bf50aae20 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:14.535802 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:14.542050 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-e5727100-45c2-458b-97b3-958bf50aae20 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lazy-loading 'services' on Instance uuid 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:42:14.629239 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e5727100-45c2-458b-97b3-958bf50aae20 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments/76b18e9c-774a-4ca2-8ea8-91af9149c017" status: 202 len: 0 microversion: 2.1 time: 0.186279 Jul 28 06:42:14.630135 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 382/763] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:42:14 2022] DELETE /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments/76b18e9c-774a-4ca2-8ea8-91af9149c017 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:42:14.638871 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e5e56571-3081-4720-95d3-d4334e464b6c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:14.641037 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e5e56571-3081-4720-95d3-d4334e464b6c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:14.649009 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e5e56571-3081-4720-95d3-d4334e464b6c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:14.649554 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e5e56571-3081-4720-95d3-d4334e464b6c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:14.650328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e5e56571-3081-4720-95d3-d4334e464b6c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:14.651102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e5e56571-3081-4720-95d3-d4334e464b6c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:14.684455 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e5e56571-3081-4720-95d3-d4334e464b6c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049463 Jul 28 06:42:14.685019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 382/764] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:42:14 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:15.248740 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-de477555-b57e-46ce-b1ab-e869b601d272 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:15.249455 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-de477555-b57e-46ce-b1ab-e869b601d272 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:15.255759 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de477555-b57e-46ce-b1ab-e869b601d272 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:15.256271 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de477555-b57e-46ce-b1ab-e869b601d272 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:15.257042 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de477555-b57e-46ce-b1ab-e869b601d272 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:15.257501 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de477555-b57e-46ce-b1ab-e869b601d272 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:15.403352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-de477555-b57e-46ce-b1ab-e869b601d272 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:15.411450 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-de477555-b57e-46ce-b1ab-e869b601d272 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1758 microversion: 2.1 time: 0.166923 Jul 28 06:42:15.412020 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 383/765] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:15 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:15.697688 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b7364174-510b-40d7-969f-70cfffcd8ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:15.699737 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b7364174-510b-40d7-969f-70cfffcd8ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:15.706287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b7364174-510b-40d7-969f-70cfffcd8ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:15.706735 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b7364174-510b-40d7-969f-70cfffcd8ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:15.707499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b7364174-510b-40d7-969f-70cfffcd8ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:15.707933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b7364174-510b-40d7-969f-70cfffcd8ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:15.738068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b7364174-510b-40d7-969f-70cfffcd8ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Jul 28 06:42:15.738635 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 383/766] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:42:15 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:16.015588 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:42:16.015787 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Thu Jul 28 06:42:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:42:16.751578 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-83297102-6ca3-44fb-ae87-d512c9cf3214 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:16.754133 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-83297102-6ca3-44fb-ae87-d512c9cf3214 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:16.761796 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-83297102-6ca3-44fb-ae87-d512c9cf3214 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:16.762244 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-83297102-6ca3-44fb-ae87-d512c9cf3214 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:16.763017 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-83297102-6ca3-44fb-ae87-d512c9cf3214 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:16.763451 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-83297102-6ca3-44fb-ae87-d512c9cf3214 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:16.797497 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-83297102-6ca3-44fb-ae87-d512c9cf3214 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050744 Jul 28 06:42:16.798072 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 384/767] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:42:16 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:17.810037 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-296d8a5b-a970-4c58-92a5-102405dbe0fc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:17.812172 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-296d8a5b-a970-4c58-92a5-102405dbe0fc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:17.820451 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-296d8a5b-a970-4c58-92a5-102405dbe0fc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:17.820907 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-296d8a5b-a970-4c58-92a5-102405dbe0fc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:17.821710 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-296d8a5b-a970-4c58-92a5-102405dbe0fc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:17.822153 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-296d8a5b-a970-4c58-92a5-102405dbe0fc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:17.852351 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-296d8a5b-a970-4c58-92a5-102405dbe0fc tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046253 Jul 28 06:42:17.852898 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 384/768] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:42:17 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:18.867857 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-789c346f-2c19-41a6-8855-e81d0eadc9a9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:18.868305 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-789c346f-2c19-41a6-8855-e81d0eadc9a9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:18.875712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-789c346f-2c19-41a6-8855-e81d0eadc9a9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:18.876272 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-789c346f-2c19-41a6-8855-e81d0eadc9a9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:18.877563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-789c346f-2c19-41a6-8855-e81d0eadc9a9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:18.878473 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-789c346f-2c19-41a6-8855-e81d0eadc9a9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:18.910978 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-789c346f-2c19-41a6-8855-e81d0eadc9a9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050773 Jul 28 06:42:18.911647 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 385/769] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:42:18 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:42:18.977121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8a45b35a-cd4a-4231-81e0-512adc631ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:18.977650 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8a45b35a-cd4a-4231-81e0-512adc631ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:18.984270 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a45b35a-cd4a-4231-81e0-512adc631ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:18.984727 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a45b35a-cd4a-4231-81e0-512adc631ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:18.985531 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a45b35a-cd4a-4231-81e0-512adc631ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:18.985973 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a45b35a-cd4a-4231-81e0-512adc631ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:19.010600 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8a45b35a-cd4a-4231-81e0-512adc631ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Going to try to terminate instance {{(pid=124563) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:42:19.084598 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8a45b35a-cd4a-4231-81e0-512adc631ec5 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 204 len: 0 microversion: 2.1 time: 0.111139 Jul 28 06:42:19.085178 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 385/770] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:42:18 2022] DELETE /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:42:19.094635 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-408d853d-7c35-417e-a7d0-2ec8d85d469e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:19.095250 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-408d853d-7c35-417e-a7d0-2ec8d85d469e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:19.101607 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-408d853d-7c35-417e-a7d0-2ec8d85d469e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:19.101997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-408d853d-7c35-417e-a7d0-2ec8d85d469e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:19.102758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-408d853d-7c35-417e-a7d0-2ec8d85d469e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:19.103285 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-408d853d-7c35-417e-a7d0-2ec8d85d469e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:19.230325 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-408d853d-7c35-417e-a7d0-2ec8d85d469e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:19.238013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-408d853d-7c35-417e-a7d0-2ec8d85d469e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1681 microversion: 2.1 time: 0.148221 Jul 28 06:42:19.238578 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 386/771] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:19 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:20.259711 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-655ed347-8974-4c92-b1c1-747f56b702ca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:20.260434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-655ed347-8974-4c92-b1c1-747f56b702ca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:20.266772 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-655ed347-8974-4c92-b1c1-747f56b702ca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:20.267213 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-655ed347-8974-4c92-b1c1-747f56b702ca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:20.268486 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-655ed347-8974-4c92-b1c1-747f56b702ca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:20.269413 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-655ed347-8974-4c92-b1c1-747f56b702ca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:20.400432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-655ed347-8974-4c92-b1c1-747f56b702ca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:20.407922 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-655ed347-8974-4c92-b1c1-747f56b702ca tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1681 microversion: 2.1 time: 0.152412 Jul 28 06:42:20.409125 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 386/772] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:20 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:20.682519 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4146ab11-2599-4081-8aa8-b4295db2d1eb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9647703-92d3-4a65-a7bd-0ad21cb4f872"}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:20.684762 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4146ab11-2599-4081-8aa8-b4295db2d1eb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:20.691540 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4146ab11-2599-4081-8aa8-b4295db2d1eb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:20.691990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4146ab11-2599-4081-8aa8-b4295db2d1eb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:20.693016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4146ab11-2599-4081-8aa8-b4295db2d1eb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:20.693483 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4146ab11-2599-4081-8aa8-b4295db2d1eb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:21.068248 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4146ab11-2599-4081-8aa8-b4295db2d1eb tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389397 Jul 28 06:42:21.068858 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 387/773] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:42:20 2022] POST /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:21.430456 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d16816c1-e595-4891-be74-0ed5526ed5d3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:21.431837 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d16816c1-e595-4891-be74-0ed5526ed5d3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:21.434978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:21.447151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d16816c1-e595-4891-be74-0ed5526ed5d3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:21.447770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d16816c1-e595-4891-be74-0ed5526ed5d3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:21.448994 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d16816c1-e595-4891-be74-0ed5526ed5d3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:21.449756 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d16816c1-e595-4891-be74-0ed5526ed5d3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:21.604596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d16816c1-e595-4891-be74-0ed5526ed5d3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:21.613615 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d16816c1-e595-4891-be74-0ed5526ed5d3 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1681 microversion: 2.1 time: 0.186956 Jul 28 06:42:21.614190 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 387/774] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:21 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:22.058027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-51913a5e-fc66-4210-bbba-7256c4a06edc req-a81a7e70-f439-4d9e-9c56-266ce4881d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3", "name": "network-vif-deleted", "tag": "b1d18864-af4e-41d6-b3f8-a68f95159ee7"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:22.068900 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-51913a5e-fc66-4210-bbba-7256c4a06edc req-a81a7e70-f439-4d9e-9c56-266ce4881d91 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:22.069363 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-51913a5e-fc66-4210-bbba-7256c4a06edc req-a81a7e70-f439-4d9e-9c56-266ce4881d91 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:22.080462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-51913a5e-fc66-4210-bbba-7256c4a06edc req-a81a7e70-f439-4d9e-9c56-266ce4881d91 service nova] Creating event network-vif-deleted:b1d18864-af4e-41d6-b3f8-a68f95159ee7 for instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 on hv-cinder-85060 Jul 28 06:42:22.086083 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-51913a5e-fc66-4210-bbba-7256c4a06edc req-a81a7e70-f439-4d9e-9c56-266ce4881d91 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032938 Jul 28 06:42:22.086720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 388/775] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:22.635357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:22.636149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:22.645267 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:22.646203 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:22.647154 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:22.647600 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:22.714385 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:22.715272 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:22.715805 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lazy-loading 'fault' on Instance uuid 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:42:22.771589 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:22.773812 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:22.780010 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-efd773c9-9263-4f5b-a336-25f453246404 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 200 len: 1330 microversion: 2.1 time: 0.148817 Jul 28 06:42:22.780844 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 388/776] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:22 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 1330 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:23.805715 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-16dbca32-e792-42fa-8614-81a098786a41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:23.806434 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-16dbca32-e792-42fa-8614-81a098786a41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:23.812671 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16dbca32-e792-42fa-8614-81a098786a41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:23.813123 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16dbca32-e792-42fa-8614-81a098786a41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:23.813918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16dbca32-e792-42fa-8614-81a098786a41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:23.814366 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16dbca32-e792-42fa-8614-81a098786a41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:23.827734 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-16dbca32-e792-42fa-8614-81a098786a41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-16dbca32-e792-42fa-8614-81a098786a41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 HTTP/1.1 Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:42:23.829428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:42:23.830766 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3'} Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:42:23.831553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:42:23.832799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:42:23.834036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-16dbca32-e792-42fa-8614-81a098786a41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:42:23.834036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-16dbca32-e792-42fa-8614-81a098786a41 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 404 len: 111 microversion: 2.1 time: 0.030103 Jul 28 06:42:23.834036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 389/777] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:23 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:42:23.840954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-107cc98f-df1b-4bab-a570-7088a3d7df64 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '.version_select at 0x7f57476a0d30>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:23.865870 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-107cc98f-df1b-4bab-a570-7088a3d7df64 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-786599056" status: 202 len: 0 microversion: 2.1 time: 0.028642 Jul 28 06:42:23.866457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 389/778] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Jul 28 06:42:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-786599056 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:42:24.473174 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6bd4ae37-43d2-464a-9b8e-255fdbe42012 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: .version_select at 0x7f57475de550>, body: {"keypair": {"name": "tempest-keypair-1926123367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2CLY69eT8jl/qns38kJx1QhSyi19KHpbGdezV/HZSvfTRP+z9hKitHqw6ZOKP45cNUvyRhs68AnhEOUbWtOv0sjk1BPIi2x9Nf3/sQZSzYIpwTG5U6GMth2H/+1hm5TA=="}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:24.489912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-6bd4ae37-43d2-464a-9b8e-255fdbe42012 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:42:24.493997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-6bd4ae37-43d2-464a-9b8e-255fdbe42012 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for user 4a1db92e28444854b9de817dd36104ea and project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:42:24.515893 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6bd4ae37-43d2-464a-9b8e-255fdbe42012 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047734 Jul 28 06:42:24.516475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 390/779] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Jul 28 06:42:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:42:26.028174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-460600042", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1658fcaf-8835-445a-a4cf-3f4534b3861e"}], "security_groups": [{"name": "tempest-securitygroup--374025908"}], "key_name": "tempest-keypair-1926123367", "user_data": "}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:26.132740 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] validate_networks() for [('1658fcaf-8835-445a-a4cf-3f4534b3861e', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:42:26.537198 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:42:26.537816 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Thu Jul 28 06:42:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:42:26.551195 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:42:26.551614 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:42:26.552085 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:42:26.552539 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:42:26.552945 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:42:26.561840 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:26.562291 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:26.563079 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:26.563505 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:26.582308 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:42:26.586449 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for user 4a1db92e28444854b9de817dd36104ea and project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:42:26.597769 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:42:26.600223 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:42:26.645727 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d44e6a29-bf8b-4a41-b747-8519ff11e3d8 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.622260 Jul 28 06:42:26.646370 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 390/780] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:42:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:42:26.658628 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-285752c1-8a1a-44d9-ad02-615e6bdb4bcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:26.659235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-285752c1-8a1a-44d9-ad02-615e6bdb4bcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:26.716435 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-285752c1-8a1a-44d9-ad02-615e6bdb4bcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:26.723427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-285752c1-8a1a-44d9-ad02-615e6bdb4bcd tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1241 microversion: 2.1 time: 0.070054 Jul 28 06:42:26.724212 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 391/781] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:26 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:27.745012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-880dd25f-bd2e-4798-9e86-0f507c85034f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:27.745659 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-880dd25f-bd2e-4798-9e86-0f507c85034f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:27.751617 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-880dd25f-bd2e-4798-9e86-0f507c85034f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:27.752062 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-880dd25f-bd2e-4798-9e86-0f507c85034f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:27.753052 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-880dd25f-bd2e-4798-9e86-0f507c85034f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:27.753530 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-880dd25f-bd2e-4798-9e86-0f507c85034f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:27.818841 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-880dd25f-bd2e-4798-9e86-0f507c85034f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:27.826339 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-880dd25f-bd2e-4798-9e86-0f507c85034f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1293 microversion: 2.1 time: 0.085942 Jul 28 06:42:27.826904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 391/782] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:27 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:28.848045 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-15a2d8a7-9d89-4792-a36e-b1c3747ad5ec tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:28.848717 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-15a2d8a7-9d89-4792-a36e-b1c3747ad5ec tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:28.856042 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15a2d8a7-9d89-4792-a36e-b1c3747ad5ec tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:28.856541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15a2d8a7-9d89-4792-a36e-b1c3747ad5ec tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:28.857427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15a2d8a7-9d89-4792-a36e-b1c3747ad5ec tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:28.857928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15a2d8a7-9d89-4792-a36e-b1c3747ad5ec tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:28.921868 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-15a2d8a7-9d89-4792-a36e-b1c3747ad5ec tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:28.929888 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-15a2d8a7-9d89-4792-a36e-b1c3747ad5ec tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1311 microversion: 2.1 time: 0.086196 Jul 28 06:42:28.930452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 392/783] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:28 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:29.865210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-90f19fff-2c53-4e08-8d75-ffb1d045bb18 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:29.867704 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-90f19fff-2c53-4e08-8d75-ffb1d045bb18 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:29.875155 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90f19fff-2c53-4e08-8d75-ffb1d045bb18 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:29.875801 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90f19fff-2c53-4e08-8d75-ffb1d045bb18 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:29.876767 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90f19fff-2c53-4e08-8d75-ffb1d045bb18 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:29.877210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-90f19fff-2c53-4e08-8d75-ffb1d045bb18 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:29.907264 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-90f19fff-2c53-4e08-8d75-ffb1d045bb18 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lazy-loading 'flavor' on Instance uuid 65a88fd0-386e-4cde-bddf-205dea943fc9 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:42:29.952330 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a797b352-fc2d-406c-ad4c-616ba33c09b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:29.953895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a797b352-fc2d-406c-ad4c-616ba33c09b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:29.955529 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:29.963217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a797b352-fc2d-406c-ad4c-616ba33c09b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:29.963792 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a797b352-fc2d-406c-ad4c-616ba33c09b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:29.964803 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a797b352-fc2d-406c-ad4c-616ba33c09b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:29.965351 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a797b352-fc2d-406c-ad4c-616ba33c09b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:30.048232 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-90f19fff-2c53-4e08-8d75-ffb1d045bb18 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/action" status: 200 len: 32 microversion: 2.1 time: 0.187664 Jul 28 06:42:30.049049 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 392/784] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:42:29 2022] POST /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:42:30.059997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-acdc8f2a-b0f2-4cfa-91ed-d3db3d1188b5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:30.060850 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-acdc8f2a-b0f2-4cfa-91ed-d3db3d1188b5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:30.069212 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-acdc8f2a-b0f2-4cfa-91ed-d3db3d1188b5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:30.069778 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-acdc8f2a-b0f2-4cfa-91ed-d3db3d1188b5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:30.070626 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-acdc8f2a-b0f2-4cfa-91ed-d3db3d1188b5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:30.071175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-acdc8f2a-b0f2-4cfa-91ed-d3db3d1188b5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:30.171022 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a797b352-fc2d-406c-ad4c-616ba33c09b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:30.179711 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a797b352-fc2d-406c-ad4c-616ba33c09b6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1366 microversion: 2.1 time: 0.231435 Jul 28 06:42:30.180591 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 393/785] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:29 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:30.297580 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-acdc8f2a-b0f2-4cfa-91ed-d3db3d1188b5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:30.306585 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-acdc8f2a-b0f2-4cfa-91ed-d3db3d1188b5 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.250734 Jul 28 06:42:30.307734 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 393/786] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:30 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:30.741471 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-6a40cdda-9078-4fa1-b29f-0f7470ffdacc req-f3902c04-5f78-457c-aa4d-49ac55a56d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ad6f45-a229-47fe-b992-d41f16bbaf72", "tag": "fffdf017-fca8-4862-83d9-4dcfd53d9e5a"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:30.758809 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-6a40cdda-9078-4fa1-b29f-0f7470ffdacc req-f3902c04-5f78-457c-aa4d-49ac55a56d9f service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:30.759272 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-6a40cdda-9078-4fa1-b29f-0f7470ffdacc req-f3902c04-5f78-457c-aa4d-49ac55a56d9f service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:30.773971 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-6a40cdda-9078-4fa1-b29f-0f7470ffdacc req-f3902c04-5f78-457c-aa4d-49ac55a56d9f service nova] Creating event network-changed:fffdf017-fca8-4862-83d9-4dcfd53d9e5a for instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 on hv-cinder-85060 Jul 28 06:42:30.778850 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-6a40cdda-9078-4fa1-b29f-0f7470ffdacc req-f3902c04-5f78-457c-aa4d-49ac55a56d9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047935 Jul 28 06:42:30.779786 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 394/787] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:31.201917 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4dff74b1-7453-45f1-9941-1df6c8f0736c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:31.202745 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4dff74b1-7453-45f1-9941-1df6c8f0736c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:31.209936 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4dff74b1-7453-45f1-9941-1df6c8f0736c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:31.210362 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4dff74b1-7453-45f1-9941-1df6c8f0736c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:31.211126 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4dff74b1-7453-45f1-9941-1df6c8f0736c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:31.211562 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4dff74b1-7453-45f1-9941-1df6c8f0736c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:31.330004 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6166bee8-fea9-4a01-b076-58ebd50465bc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:31.330603 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6166bee8-fea9-4a01-b076-58ebd50465bc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:31.337174 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6166bee8-fea9-4a01-b076-58ebd50465bc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:31.337657 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6166bee8-fea9-4a01-b076-58ebd50465bc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:31.338413 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6166bee8-fea9-4a01-b076-58ebd50465bc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:31.338840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6166bee8-fea9-4a01-b076-58ebd50465bc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:31.417215 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4dff74b1-7453-45f1-9941-1df6c8f0736c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:31.425068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4dff74b1-7453-45f1-9941-1df6c8f0736c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1366 microversion: 2.1 time: 0.227122 Jul 28 06:42:31.426014 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 394/788] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:31 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:31.479142 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6166bee8-fea9-4a01-b076-58ebd50465bc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:31.487604 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6166bee8-fea9-4a01-b076-58ebd50465bc tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.162316 Jul 28 06:42:31.488191 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 395/789] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:31 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:32.446663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-03664413-f9d0-4fbd-ac36-bc4843ddb46e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:32.447295 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-03664413-f9d0-4fbd-ac36-bc4843ddb46e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:32.453869 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03664413-f9d0-4fbd-ac36-bc4843ddb46e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:32.454385 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03664413-f9d0-4fbd-ac36-bc4843ddb46e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:32.455079 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03664413-f9d0-4fbd-ac36-bc4843ddb46e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:32.455571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03664413-f9d0-4fbd-ac36-bc4843ddb46e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:32.510446 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-278cd2c9-77ce-448d-8196-b4e4360305d0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:32.511036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-278cd2c9-77ce-448d-8196-b4e4360305d0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:32.517584 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-278cd2c9-77ce-448d-8196-b4e4360305d0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:32.518033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-278cd2c9-77ce-448d-8196-b4e4360305d0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:32.518836 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-278cd2c9-77ce-448d-8196-b4e4360305d0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:32.519270 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-278cd2c9-77ce-448d-8196-b4e4360305d0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:32.630979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-03664413-f9d0-4fbd-ac36-bc4843ddb46e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:32.639532 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-03664413-f9d0-4fbd-ac36-bc4843ddb46e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1366 microversion: 2.1 time: 0.196974 Jul 28 06:42:32.654447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 395/790] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:32 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:32.657170 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-278cd2c9-77ce-448d-8196-b4e4360305d0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:32.665727 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-278cd2c9-77ce-448d-8196-b4e4360305d0 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.159102 Jul 28 06:42:32.666298 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 396/791] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:32 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:33.662297 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-bc62c3e9-a72d-480e-a70e-ec64beef9ae2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:33.662836 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-bc62c3e9-a72d-480e-a70e-ec64beef9ae2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:33.670031 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bc62c3e9-a72d-480e-a70e-ec64beef9ae2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:33.670554 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bc62c3e9-a72d-480e-a70e-ec64beef9ae2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:33.671321 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bc62c3e9-a72d-480e-a70e-ec64beef9ae2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:33.671759 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bc62c3e9-a72d-480e-a70e-ec64beef9ae2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:33.686269 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-36213d04-8ccf-44a1-9f93-48ea528558ca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:33.687119 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-36213d04-8ccf-44a1-9f93-48ea528558ca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:33.693783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-36213d04-8ccf-44a1-9f93-48ea528558ca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:33.694228 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-36213d04-8ccf-44a1-9f93-48ea528558ca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:33.694984 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-36213d04-8ccf-44a1-9f93-48ea528558ca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:33.695411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-36213d04-8ccf-44a1-9f93-48ea528558ca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:33.806525 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-bc62c3e9-a72d-480e-a70e-ec64beef9ae2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:33.814144 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-bc62c3e9-a72d-480e-a70e-ec64beef9ae2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1366 microversion: 2.1 time: 0.156415 Jul 28 06:42:33.815539 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 396/792] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:33 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:33.842449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-36213d04-8ccf-44a1-9f93-48ea528558ca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:33.851169 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-36213d04-8ccf-44a1-9f93-48ea528558ca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.168686 Jul 28 06:42:33.851749 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 397/793] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:33 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:34.836682 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1e2594b3-e35e-4791-a85a-29e9c916eaeb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:34.837317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1e2594b3-e35e-4791-a85a-29e9c916eaeb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:34.843981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e2594b3-e35e-4791-a85a-29e9c916eaeb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:34.844431 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e2594b3-e35e-4791-a85a-29e9c916eaeb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:34.845210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e2594b3-e35e-4791-a85a-29e9c916eaeb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:34.845692 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e2594b3-e35e-4791-a85a-29e9c916eaeb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:34.873553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f6e269bf-55c9-4ddc-b666-30fab3e07dca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:34.875242 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f6e269bf-55c9-4ddc-b666-30fab3e07dca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:34.887393 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f6e269bf-55c9-4ddc-b666-30fab3e07dca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:34.887761 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f6e269bf-55c9-4ddc-b666-30fab3e07dca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:34.888752 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f6e269bf-55c9-4ddc-b666-30fab3e07dca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:34.889192 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f6e269bf-55c9-4ddc-b666-30fab3e07dca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:35.007869 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1e2594b3-e35e-4791-a85a-29e9c916eaeb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:35.015602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1e2594b3-e35e-4791-a85a-29e9c916eaeb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1366 microversion: 2.1 time: 0.182869 Jul 28 06:42:35.016186 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 397/794] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:34 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:35.038978 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f6e269bf-55c9-4ddc-b666-30fab3e07dca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:35.047113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f6e269bf-55c9-4ddc-b666-30fab3e07dca tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.178733 Jul 28 06:42:35.047692 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 398/795] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:34 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:36.036650 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2d65ee7d-6eca-4fc7-a69a-5bcd49b6b319 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:36.037269 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2d65ee7d-6eca-4fc7-a69a-5bcd49b6b319 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:36.043684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d65ee7d-6eca-4fc7-a69a-5bcd49b6b319 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.044124 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d65ee7d-6eca-4fc7-a69a-5bcd49b6b319 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:36.044874 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d65ee7d-6eca-4fc7-a69a-5bcd49b6b319 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.045329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d65ee7d-6eca-4fc7-a69a-5bcd49b6b319 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:36.075825 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-82b553d5-dbeb-495c-a9ca-e944bc08b34b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:36.076589 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-82b553d5-dbeb-495c-a9ca-e944bc08b34b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:36.083758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-82b553d5-dbeb-495c-a9ca-e944bc08b34b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.084347 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-82b553d5-dbeb-495c-a9ca-e944bc08b34b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:36.085196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-82b553d5-dbeb-495c-a9ca-e944bc08b34b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.085672 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-82b553d5-dbeb-495c-a9ca-e944bc08b34b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:36.179607 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d65ee7d-6eca-4fc7-a69a-5bcd49b6b319 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:36.187506 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2d65ee7d-6eca-4fc7-a69a-5bcd49b6b319 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1366 microversion: 2.1 time: 0.155317 Jul 28 06:42:36.188283 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 398/796] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:36 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:36.219093 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-82b553d5-dbeb-495c-a9ca-e944bc08b34b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:36.228334 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-82b553d5-dbeb-495c-a9ca-e944bc08b34b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.156326 Jul 28 06:42:36.228993 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 399/797] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:36 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:36.324548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-907e4fab-8bc4-4939-87d3-f361282b5752 req-25143a16-1de8-44b6-ab79-6001e3b361c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ad6f45-a229-47fe-b992-d41f16bbaf72", "name": "network-vif-plugged", "status": "completed", "tag": "fffdf017-fca8-4862-83d9-4dcfd53d9e5a"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:36.335077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-907e4fab-8bc4-4939-87d3-f361282b5752 req-25143a16-1de8-44b6-ab79-6001e3b361c5 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.335585 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-907e4fab-8bc4-4939-87d3-f361282b5752 req-25143a16-1de8-44b6-ab79-6001e3b361c5 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:36.346799 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-907e4fab-8bc4-4939-87d3-f361282b5752 req-25143a16-1de8-44b6-ab79-6001e3b361c5 service nova] Creating event network-vif-plugged:fffdf017-fca8-4862-83d9-4dcfd53d9e5a for instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 on hv-cinder-85060 Jul 28 06:42:36.351641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-907e4fab-8bc4-4939-87d3-f361282b5752 req-25143a16-1de8-44b6-ab79-6001e3b361c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030840 Jul 28 06:42:36.352245 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 399/798] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:36.683444 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d6a48fd9-4783-4994-9ed8-e624d6fa95db tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:36.684031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d6a48fd9-4783-4994-9ed8-e624d6fa95db tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:36.690086 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d6a48fd9-4783-4994-9ed8-e624d6fa95db tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.690540 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d6a48fd9-4783-4994-9ed8-e624d6fa95db tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:36.691300 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d6a48fd9-4783-4994-9ed8-e624d6fa95db tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.692568 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d6a48fd9-4783-4994-9ed8-e624d6fa95db tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:36.722594 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=6 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:36.728612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d6a48fd9-4783-4994-9ed8-e624d6fa95db tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments/1de70103-7362-4bf5-a603-8698e8bea7fa" status: 200 len: 194 microversion: 2.20 time: 0.167159 Jul 28 06:42:36.732671 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 400/799] 10.222.0.20 () {60 vars in 1454 bytes} [Thu Jul 28 06:42:36 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments/1de70103-7362-4bf5-a603-8698e8bea7fa => generated 194 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:42:36.796690 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:36.797647 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=6 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:36.802319 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-32de9353-07f9-4836-8317-1ee6182bca93 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:36.802852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-32de9353-07f9-4836-8317-1ee6182bca93 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:36.810119 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-32de9353-07f9-4836-8317-1ee6182bca93 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.810575 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-32de9353-07f9-4836-8317-1ee6182bca93 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:36.811353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-32de9353-07f9-4836-8317-1ee6182bca93 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.811792 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-32de9353-07f9-4836-8317-1ee6182bca93 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:36.897263 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-32de9353-07f9-4836-8317-1ee6182bca93 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lazy-loading 'services' on Instance uuid 019e1e9c-7545-477a-bae9-47c555ae07e2 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:42:36.969134 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-32de9353-07f9-4836-8317-1ee6182bca93 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments/1de70103-7362-4bf5-a603-8698e8bea7fa" status: 202 len: 0 microversion: 2.20 time: 0.172791 Jul 28 06:42:36.969701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 400/800] 10.222.0.20 () {60 vars in 1457 bytes} [Thu Jul 28 06:42:36 2022] DELETE /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments/1de70103-7362-4bf5-a603-8698e8bea7fa => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:42:36.979809 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-05252ea1-2796-48b5-b812-4a8ca7122171 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:36.982074 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-05252ea1-2796-48b5-b812-4a8ca7122171 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:36.988243 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-05252ea1-2796-48b5-b812-4a8ca7122171 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.988759 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-05252ea1-2796-48b5-b812-4a8ca7122171 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:36.989907 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-05252ea1-2796-48b5-b812-4a8ca7122171 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:36.990252 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-05252ea1-2796-48b5-b812-4a8ca7122171 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:37.006678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:37.025469 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-05252ea1-2796-48b5-b812-4a8ca7122171 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050000 Jul 28 06:42:37.026250 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 401/801] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Jul 28 06:42:36 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:42:37.214416 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8a7cbda2-1df4-42f4-af39-00142cbffced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:37.215941 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8a7cbda2-1df4-42f4-af39-00142cbffced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:37.225248 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a7cbda2-1df4-42f4-af39-00142cbffced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:37.225731 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a7cbda2-1df4-42f4-af39-00142cbffced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:37.226544 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a7cbda2-1df4-42f4-af39-00142cbffced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:37.227160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a7cbda2-1df4-42f4-af39-00142cbffced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:37.250148 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f4bc75a9-ca14-46ec-99c6-d9c918660a2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:37.251079 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f4bc75a9-ca14-46ec-99c6-d9c918660a2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:37.260199 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4bc75a9-ca14-46ec-99c6-d9c918660a2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:37.261261 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4bc75a9-ca14-46ec-99c6-d9c918660a2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:37.262382 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4bc75a9-ca14-46ec-99c6-d9c918660a2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:37.263023 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f4bc75a9-ca14-46ec-99c6-d9c918660a2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:37.373348 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8a7cbda2-1df4-42f4-af39-00142cbffced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:37.382423 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8a7cbda2-1df4-42f4-af39-00142cbffced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1366 microversion: 2.1 time: 0.177612 Jul 28 06:42:37.383088 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 401/802] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:37 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:37.416838 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f4bc75a9-ca14-46ec-99c6-d9c918660a2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:37.425146 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f4bc75a9-ca14-46ec-99c6-d9c918660a2b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.179171 Jul 28 06:42:37.425865 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 402/803] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:37 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:38.038676 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0d0370aa-c136-43e8-9c48-148d50325c3f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:38.040983 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0d0370aa-c136-43e8-9c48-148d50325c3f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:38.047182 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d0370aa-c136-43e8-9c48-148d50325c3f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:38.047633 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d0370aa-c136-43e8-9c48-148d50325c3f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:38.048405 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d0370aa-c136-43e8-9c48-148d50325c3f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:38.048844 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d0370aa-c136-43e8-9c48-148d50325c3f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:38.079650 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0d0370aa-c136-43e8-9c48-148d50325c3f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045467 Jul 28 06:42:38.080066 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 402/804] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Jul 28 06:42:38 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:42:38.404098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-808d68f5-22de-4949-b037-35852d1ad744 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:38.404841 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-808d68f5-22de-4949-b037-35852d1ad744 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:38.411986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-808d68f5-22de-4949-b037-35852d1ad744 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:38.412628 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-808d68f5-22de-4949-b037-35852d1ad744 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:38.413429 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-808d68f5-22de-4949-b037-35852d1ad744 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:38.413871 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-808d68f5-22de-4949-b037-35852d1ad744 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:38.456902 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-37041ce6-a1e3-4d8f-abf5-c6448082b1a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:38.457628 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-37041ce6-a1e3-4d8f-abf5-c6448082b1a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:38.464906 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-37041ce6-a1e3-4d8f-abf5-c6448082b1a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:38.465555 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-37041ce6-a1e3-4d8f-abf5-c6448082b1a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:38.466651 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-37041ce6-a1e3-4d8f-abf5-c6448082b1a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:38.467282 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-37041ce6-a1e3-4d8f-abf5-c6448082b1a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:38.570887 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-808d68f5-22de-4949-b037-35852d1ad744 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:38.578630 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-808d68f5-22de-4949-b037-35852d1ad744 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1556 microversion: 2.1 time: 0.178793 Jul 28 06:42:38.579200 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 403/805] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:38 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:38.616540 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f5f0f52a-d794-419d-ae06-f04bac82005e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:38.617043 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f5f0f52a-d794-419d-ae06-f04bac82005e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:38.623116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-37041ce6-a1e3-4d8f-abf5-c6448082b1a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:38.632468 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-37041ce6-a1e3-4d8f-abf5-c6448082b1a9 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.186748 Jul 28 06:42:38.635746 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f5f0f52a-d794-419d-ae06-f04bac82005e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:38.636408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 403/806] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:38 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:38.636864 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f5f0f52a-d794-419d-ae06-f04bac82005e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:38.637741 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f5f0f52a-d794-419d-ae06-f04bac82005e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:38.638177 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f5f0f52a-d794-419d-ae06-f04bac82005e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:38.720342 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f5f0f52a-d794-419d-ae06-f04bac82005e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123308 Jul 28 06:42:38.720956 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 404/807] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Jul 28 06:42:38 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:39.092260 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6abb303d-3bb5-45e6-bb79-8abd73775e4b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:39.094474 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6abb303d-3bb5-45e6-bb79-8abd73775e4b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:39.101408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6abb303d-3bb5-45e6-bb79-8abd73775e4b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:39.101862 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6abb303d-3bb5-45e6-bb79-8abd73775e4b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:39.102635 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6abb303d-3bb5-45e6-bb79-8abd73775e4b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:39.103071 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6abb303d-3bb5-45e6-bb79-8abd73775e4b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:39.134966 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6abb303d-3bb5-45e6-bb79-8abd73775e4b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046577 Jul 28 06:42:39.135644 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 404/808] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Jul 28 06:42:39 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:42:39.660351 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-de8b423e-a072-435c-96f7-0f434a1552af tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:39.660810 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-de8b423e-a072-435c-96f7-0f434a1552af tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:39.672639 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de8b423e-a072-435c-96f7-0f434a1552af tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:39.674038 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de8b423e-a072-435c-96f7-0f434a1552af tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:39.676806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de8b423e-a072-435c-96f7-0f434a1552af tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:39.678387 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-de8b423e-a072-435c-96f7-0f434a1552af tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:39.708840 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-6ed5b449-5efc-4793-ac2e-665616d05fdd req-f3a65f0e-d0cd-4cb5-b6c1-d85d91e27473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ad6f45-a229-47fe-b992-d41f16bbaf72", "tag": "fffdf017-fca8-4862-83d9-4dcfd53d9e5a"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:39.720121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-6ed5b449-5efc-4793-ac2e-665616d05fdd req-f3a65f0e-d0cd-4cb5-b6c1-d85d91e27473 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:39.720558 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-6ed5b449-5efc-4793-ac2e-665616d05fdd req-f3a65f0e-d0cd-4cb5-b6c1-d85d91e27473 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:39.727050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:39.736675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-6ed5b449-5efc-4793-ac2e-665616d05fdd req-f3a65f0e-d0cd-4cb5-b6c1-d85d91e27473 service nova] Creating event network-changed:fffdf017-fca8-4862-83d9-4dcfd53d9e5a for instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 on hv-cinder-85060 Jul 28 06:42:39.744134 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-6ed5b449-5efc-4793-ac2e-665616d05fdd req-f3a65f0e-d0cd-4cb5-b6c1-d85d91e27473 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052202 Jul 28 06:42:39.745081 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 405/809] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:39.829935 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-de8b423e-a072-435c-96f7-0f434a1552af tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:39.839381 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-de8b423e-a072-435c-96f7-0f434a1552af tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.185469 Jul 28 06:42:39.853173 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 405/810] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:39 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:40.148995 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a1265358-dae0-4b49-87d1-b95a365b1cf2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:40.152756 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a1265358-dae0-4b49-87d1-b95a365b1cf2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:40.160384 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a1265358-dae0-4b49-87d1-b95a365b1cf2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:40.161688 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a1265358-dae0-4b49-87d1-b95a365b1cf2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:40.162664 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a1265358-dae0-4b49-87d1-b95a365b1cf2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:40.163297 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a1265358-dae0-4b49-87d1-b95a365b1cf2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:40.199032 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a1265358-dae0-4b49-87d1-b95a365b1cf2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055411 Jul 28 06:42:40.205318 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 406/811] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Jul 28 06:42:40 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:40.268302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-673a721c-7095-4646-8846-a172dab3d933 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:40.268796 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-673a721c-7095-4646-8846-a172dab3d933 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:40.276769 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-673a721c-7095-4646-8846-a172dab3d933 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:40.277253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-673a721c-7095-4646-8846-a172dab3d933 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:40.278341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-673a721c-7095-4646-8846-a172dab3d933 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:40.278864 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-673a721c-7095-4646-8846-a172dab3d933 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:40.305335 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-673a721c-7095-4646-8846-a172dab3d933 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:42:40.396016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-673a721c-7095-4646-8846-a172dab3d933 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 204 len: 0 microversion: 2.20 time: 0.130421 Jul 28 06:42:40.396992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 406/812] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Jul 28 06:42:40 2022] DELETE /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 06:42:40.416534 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3a3654a0-9334-458c-9ab9-05cbaa8933f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:40.417152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3a3654a0-9334-458c-9ab9-05cbaa8933f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:40.423699 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3a3654a0-9334-458c-9ab9-05cbaa8933f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:40.424147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3a3654a0-9334-458c-9ab9-05cbaa8933f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:40.424906 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3a3654a0-9334-458c-9ab9-05cbaa8933f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:40.425360 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3a3654a0-9334-458c-9ab9-05cbaa8933f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:40.560677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3a3654a0-9334-458c-9ab9-05cbaa8933f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:40.569559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3a3654a0-9334-458c-9ab9-05cbaa8933f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:40.571050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3a3654a0-9334-458c-9ab9-05cbaa8933f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:40.572192 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3a3654a0-9334-458c-9ab9-05cbaa8933f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.169877 Jul 28 06:42:40.572743 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 407/813] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:40 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:40.860440 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ca35d645-ee50-4934-8eb3-a0f4f78b3d30 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:40.861145 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ca35d645-ee50-4934-8eb3-a0f4f78b3d30 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:40.868319 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ca35d645-ee50-4934-8eb3-a0f4f78b3d30 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:40.868765 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ca35d645-ee50-4934-8eb3-a0f4f78b3d30 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:40.869566 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ca35d645-ee50-4934-8eb3-a0f4f78b3d30 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:40.870003 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ca35d645-ee50-4934-8eb3-a0f4f78b3d30 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:40.998535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ca35d645-ee50-4934-8eb3-a0f4f78b3d30 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:41.006401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ca35d645-ee50-4934-8eb3-a0f4f78b3d30 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.150241 Jul 28 06:42:41.006975 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 407/814] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:40 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:41.595093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-aba60c64-0833-4158-bf5b-a6ed2603e298 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:41.595740 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-aba60c64-0833-4158-bf5b-a6ed2603e298 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:41.602383 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aba60c64-0833-4158-bf5b-a6ed2603e298 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:41.602839 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aba60c64-0833-4158-bf5b-a6ed2603e298 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:41.603606 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aba60c64-0833-4158-bf5b-a6ed2603e298 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:41.604045 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-aba60c64-0833-4158-bf5b-a6ed2603e298 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:41.737372 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-aba60c64-0833-4158-bf5b-a6ed2603e298 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:41.745426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-aba60c64-0833-4158-bf5b-a6ed2603e298 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:41.746942 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-aba60c64-0833-4158-bf5b-a6ed2603e298 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:41.748101 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-aba60c64-0833-4158-bf5b-a6ed2603e298 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.156914 Jul 28 06:42:41.748659 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 408/815] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:41 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:42.027340 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b112c21d-e502-44ce-8374-273098015062 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:42.027885 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b112c21d-e502-44ce-8374-273098015062 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:42.034404 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b112c21d-e502-44ce-8374-273098015062 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:42.034861 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b112c21d-e502-44ce-8374-273098015062 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:42.035629 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b112c21d-e502-44ce-8374-273098015062 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:42.036069 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b112c21d-e502-44ce-8374-273098015062 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:42.168512 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b112c21d-e502-44ce-8374-273098015062 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:42.176960 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b112c21d-e502-44ce-8374-273098015062 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.153032 Jul 28 06:42:42.178095 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 408/816] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:42 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:42.772434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-95537342-e405-4462-8e18-5a3ed2ae24ec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:42.773046 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-95537342-e405-4462-8e18-5a3ed2ae24ec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:42.779647 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-95537342-e405-4462-8e18-5a3ed2ae24ec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:42.780103 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-95537342-e405-4462-8e18-5a3ed2ae24ec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:42.780862 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-95537342-e405-4462-8e18-5a3ed2ae24ec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:42.781311 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-95537342-e405-4462-8e18-5a3ed2ae24ec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:42.907256 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-95537342-e405-4462-8e18-5a3ed2ae24ec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:42.916128 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-95537342-e405-4462-8e18-5a3ed2ae24ec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:42.917670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-95537342-e405-4462-8e18-5a3ed2ae24ec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:42.918836 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-95537342-e405-4462-8e18-5a3ed2ae24ec tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.151215 Jul 28 06:42:42.919391 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 409/817] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:42 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:43.199186 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-00374a31-1901-4889-a032-f64f86341c41 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:43.199791 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-00374a31-1901-4889-a032-f64f86341c41 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:43.206187 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-00374a31-1901-4889-a032-f64f86341c41 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:43.206627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-00374a31-1901-4889-a032-f64f86341c41 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:43.207373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-00374a31-1901-4889-a032-f64f86341c41 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:43.208427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-00374a31-1901-4889-a032-f64f86341c41 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:43.340981 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-00374a31-1901-4889-a032-f64f86341c41 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:43.348823 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-00374a31-1901-4889-a032-f64f86341c41 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.153521 Jul 28 06:42:43.349403 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 409/818] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:43 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:43.942919 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d553698b-f370-4655-b4c8-65bccc46ca3d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:43.943725 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d553698b-f370-4655-b4c8-65bccc46ca3d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:43.950346 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d553698b-f370-4655-b4c8-65bccc46ca3d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:43.950801 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d553698b-f370-4655-b4c8-65bccc46ca3d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:43.951571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d553698b-f370-4655-b4c8-65bccc46ca3d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:43.952010 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d553698b-f370-4655-b4c8-65bccc46ca3d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:44.184680 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d553698b-f370-4655-b4c8-65bccc46ca3d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:44.193610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d553698b-f370-4655-b4c8-65bccc46ca3d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:44.195069 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d553698b-f370-4655-b4c8-65bccc46ca3d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:44.196234 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d553698b-f370-4655-b4c8-65bccc46ca3d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1722 microversion: 2.20 time: 0.258112 Jul 28 06:42:44.196793 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 410/819] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:43 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:44.375062 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6bb1aa5a-96b1-4996-9bd6-135cc42c6476 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:44.376257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6bb1aa5a-96b1-4996-9bd6-135cc42c6476 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:44.383511 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6bb1aa5a-96b1-4996-9bd6-135cc42c6476 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:44.384068 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6bb1aa5a-96b1-4996-9bd6-135cc42c6476 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:44.384944 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6bb1aa5a-96b1-4996-9bd6-135cc42c6476 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:44.385512 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6bb1aa5a-96b1-4996-9bd6-135cc42c6476 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:44.541586 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6bb1aa5a-96b1-4996-9bd6-135cc42c6476 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:44.549741 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6bb1aa5a-96b1-4996-9bd6-135cc42c6476 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.183515 Jul 28 06:42:44.550308 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 410/820] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:44 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:45.223073 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:45.224340 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:45.233042 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:45.233691 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:45.234639 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:45.235047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:45.277125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:45.277584 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:45.278401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lazy-loading 'fault' on Instance uuid 019e1e9c-7545-477a-bae9-47c555ae07e2 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:42:45.303260 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-0359e842-17e7-49ff-a0da-08c30c9b234e req-a170b88e-7eca-4b20-a36a-d79ab0cd30d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019e1e9c-7545-477a-bae9-47c555ae07e2", "name": "network-vif-deleted", "tag": "626917cf-1bf9-47dd-b3eb-784f6c8fdad0"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:45.331560 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-0359e842-17e7-49ff-a0da-08c30c9b234e req-a170b88e-7eca-4b20-a36a-d79ab0cd30d1 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:45.332016 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-0359e842-17e7-49ff-a0da-08c30c9b234e req-a170b88e-7eca-4b20-a36a-d79ab0cd30d1 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:45.340900 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:45.344576 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-0359e842-17e7-49ff-a0da-08c30c9b234e req-a170b88e-7eca-4b20-a36a-d79ab0cd30d1 service nova] Creating event network-vif-deleted:626917cf-1bf9-47dd-b3eb-784f6c8fdad0 for instance 019e1e9c-7545-477a-bae9-47c555ae07e2 on hv-cinder-85060 Jul 28 06:42:45.349377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-0359e842-17e7-49ff-a0da-08c30c9b234e req-a170b88e-7eca-4b20-a36a-d79ab0cd30d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211675 Jul 28 06:42:45.350174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 411/821] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:45.350955 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:45.353040 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:45.354350 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a15e8078-1e0e-4a7c-b0d0-f0efce2c2568 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 200 len: 1371 microversion: 2.20 time: 0.137161 Jul 28 06:42:45.354965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 411/822] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:45 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 1371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:45.574325 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a18aeb06-4e75-417d-8319-fdc2f13e66c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:45.575207 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a18aeb06-4e75-417d-8319-fdc2f13e66c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:45.581512 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a18aeb06-4e75-417d-8319-fdc2f13e66c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:45.581964 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a18aeb06-4e75-417d-8319-fdc2f13e66c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:45.583460 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a18aeb06-4e75-417d-8319-fdc2f13e66c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:45.584209 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a18aeb06-4e75-417d-8319-fdc2f13e66c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:45.741454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a18aeb06-4e75-417d-8319-fdc2f13e66c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:45.749956 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a18aeb06-4e75-417d-8319-fdc2f13e66c8 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.181331 Jul 28 06:42:45.751516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 412/823] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:45 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:46.377133 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-129f7d8a-6b12-48a6-b374-ad8e9418591d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:46.377795 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-129f7d8a-6b12-48a6-b374-ad8e9418591d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:46.384307 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-129f7d8a-6b12-48a6-b374-ad8e9418591d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:46.384749 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-129f7d8a-6b12-48a6-b374-ad8e9418591d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:46.385533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-129f7d8a-6b12-48a6-b374-ad8e9418591d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:46.385961 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-129f7d8a-6b12-48a6-b374-ad8e9418591d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:46.399768 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-129f7d8a-6b12-48a6-b374-ad8e9418591d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] HTTP exception thrown: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-129f7d8a-6b12-48a6-b374-ad8e9418591d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Request method failure captured: Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 HTTP/1.1 Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6b8O3pYD7VnRIzhBncIQzjFR54g8lp8_mRMFsLgqHHWC-hT0Hy0D8sVexpjDErylru-WXRcMr07Nyc3ikMCEdfoLwxPVbN2hySS9tZXaTbY6yTlPK6LLXEwkkbDK_JtWMZ9oBh0G_GnJHuELoqo4Z_iah7eXfMeLBkZDCScoQpaPo Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:42:46.401427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9e0dc09f9844b57bf7b38a5d4e54e17", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}] Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: cf13ae714ad04d6696c273603bba9fbc Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:42:46.403109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '019e1e9c-7545-477a-bae9-47c555ae07e2'} Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:42:46.404033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:42:46.405872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:42:46.407183 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-129f7d8a-6b12-48a6-b374-ad8e9418591d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Returning 404 to user: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:42:46.407183 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-129f7d8a-6b12-48a6-b374-ad8e9418591d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 404 len: 111 microversion: 2.20 time: 0.029560 Jul 28 06:42:46.407183 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 412/824] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:46 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:42:46.412350 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e95dcaa1-455a-4f58-a5ea-841a8e9db70e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '.version_select at 0x7f57476a0820>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:46.431235 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e95dcaa1-455a-4f58-a5ea-841a8e9db70e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1528991387" status: 204 len: 0 microversion: 2.20 time: 0.023287 Jul 28 06:42:46.431789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 413/825] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Jul 28 06:42:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1528991387 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 06:42:46.773258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2aa64072-db39-49da-8cb0-32b70d594f69 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:46.773917 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2aa64072-db39-49da-8cb0-32b70d594f69 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:46.780241 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2aa64072-db39-49da-8cb0-32b70d594f69 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:46.780911 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2aa64072-db39-49da-8cb0-32b70d594f69 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:46.781931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2aa64072-db39-49da-8cb0-32b70d594f69 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:46.782575 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2aa64072-db39-49da-8cb0-32b70d594f69 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:46.938742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2aa64072-db39-49da-8cb0-32b70d594f69 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:46.950141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2aa64072-db39-49da-8cb0-32b70d594f69 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.181546 Jul 28 06:42:46.950918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 413/826] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:46 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:47.115410 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-732406e3-802d-40d1-ad3d-53fcd2cbe5f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Action: 'create', calling method: .version_select at 0x7f574764be50>, body: {"keypair": {"name": "tempest-keypair-591201761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPRMLQat1OnXo7ZrLLQLnu6P9w9LkZz/F4GXfD4ReMbC+bp1fIQ9b62mg2RtfcqiTfDYrb6ZxUXNBInha4z3Ams43CfLN1Ddpl/etKuvFy6DTUehcsJzh4xqPuVZZLeEw=="}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:47.132234 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-732406e3-802d-40d1-ad3d-53fcd2cbe5f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Getting quotas for project d9e0dc09f9844b57bf7b38a5d4e54e17. Resources: {'key_pairs'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:42:47.136127 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-732406e3-802d-40d1-ad3d-53fcd2cbe5f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Getting quotas for user cf13ae714ad04d6696c273603bba9fbc and project d9e0dc09f9844b57bf7b38a5d4e54e17. Resources: {'key_pairs'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:42:47.158245 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-732406e3-802d-40d1-ad3d-53fcd2cbe5f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047432 Jul 28 06:42:47.158852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 414/827] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Jul 28 06:42:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 06:42:47.972035 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-442c0ecf-789a-4d85-b5e6-751c9a0fbd4e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:47.972776 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-442c0ecf-789a-4d85-b5e6-751c9a0fbd4e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:47.980013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-442c0ecf-789a-4d85-b5e6-751c9a0fbd4e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:47.980462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-442c0ecf-789a-4d85-b5e6-751c9a0fbd4e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:47.981235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-442c0ecf-789a-4d85-b5e6-751c9a0fbd4e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:47.981698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-442c0ecf-789a-4d85-b5e6-751c9a0fbd4e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:48.177008 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-442c0ecf-789a-4d85-b5e6-751c9a0fbd4e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:48.184902 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-442c0ecf-789a-4d85-b5e6-751c9a0fbd4e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.216725 Jul 28 06:42:48.185692 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 414/828] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:47 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:48.695538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1833243707", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85e85b9c-60b1-412d-a087-859c9e65f8e8"}], "security_groups": [{"name": "tempest-securitygroup--882562657"}], "key_name": "tempest-keypair-591201761", "user_data": "}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:48.798125 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] validate_networks() for [('85e85b9c-60b1-412d-a087-859c9e65f8e8', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:42:49.169144 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:42:49.169626 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:42:49.170119 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:42:49.170523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:42:49.170930 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:42:49.180241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:49.180683 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:49.181508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:49.181939 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:49.199965 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Getting quotas for project d9e0dc09f9844b57bf7b38a5d4e54e17. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:42:49.203916 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Getting quotas for user cf13ae714ad04d6696c273603bba9fbc and project d9e0dc09f9844b57bf7b38a5d4e54e17. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:42:49.207204 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5e55af87-375f-4e2e-9cca-e2d1a7c4a39f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:49.208912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5e55af87-375f-4e2e-9cca-e2d1a7c4a39f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:49.214870 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5e55af87-375f-4e2e-9cca-e2d1a7c4a39f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:49.215202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:49.215349 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5e55af87-375f-4e2e-9cca-e2d1a7c4a39f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:49.216122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5e55af87-375f-4e2e-9cca-e2d1a7c4a39f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:49.216599 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5e55af87-375f-4e2e-9cca-e2d1a7c4a39f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:49.218115 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:42:49.220387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:42:49.271173 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4505dba9-4d49-4845-ae16-d948c97c5771 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.580568 Jul 28 06:42:49.272480 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 415/829] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Jul 28 06:42:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 06:42:49.284384 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dcc7ae69-c085-43a9-afce-5b1e341a96d4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:49.285008 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-dcc7ae69-c085-43a9-afce-5b1e341a96d4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:49.349164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dcc7ae69-c085-43a9-afce-5b1e341a96d4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:49.355868 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5e55af87-375f-4e2e-9cca-e2d1a7c4a39f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:49.357051 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dcc7ae69-c085-43a9-afce-5b1e341a96d4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:49.358609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dcc7ae69-c085-43a9-afce-5b1e341a96d4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:49.359908 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-dcc7ae69-c085-43a9-afce-5b1e341a96d4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1281 microversion: 2.20 time: 0.080053 Jul 28 06:42:49.360499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 416/830] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:49 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:49.366604 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5e55af87-375f-4e2e-9cca-e2d1a7c4a39f tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.163320 Jul 28 06:42:49.367703 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 415/831] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:49 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:50.383543 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5a828b3f-d72a-438c-be8d-812186997193 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:50.384302 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5a828b3f-d72a-438c-be8d-812186997193 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:50.389437 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0e3fa6a0-203c-424f-a4f7-715945ead587 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:50.390054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0e3fa6a0-203c-424f-a4f7-715945ead587 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:50.391724 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a828b3f-d72a-438c-be8d-812186997193 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:50.392174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a828b3f-d72a-438c-be8d-812186997193 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:50.392936 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a828b3f-d72a-438c-be8d-812186997193 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:50.393389 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a828b3f-d72a-438c-be8d-812186997193 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:50.397059 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0e3fa6a0-203c-424f-a4f7-715945ead587 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:50.397546 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0e3fa6a0-203c-424f-a4f7-715945ead587 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:50.398335 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0e3fa6a0-203c-424f-a4f7-715945ead587 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:50.398803 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0e3fa6a0-203c-424f-a4f7-715945ead587 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:50.469112 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5a828b3f-d72a-438c-be8d-812186997193 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:50.479798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5a828b3f-d72a-438c-be8d-812186997193 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:50.481337 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5a828b3f-d72a-438c-be8d-812186997193 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:50.482442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5a828b3f-d72a-438c-be8d-812186997193 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1333 microversion: 2.20 time: 0.103524 Jul 28 06:42:50.482990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 417/832] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:50 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:50.537440 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0e3fa6a0-203c-424f-a4f7-715945ead587 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:50.545370 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0e3fa6a0-203c-424f-a4f7-715945ead587 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1737 microversion: 2.1 time: 0.159826 Jul 28 06:42:50.545937 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 416/833] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:50 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:51.505834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d1498571-5a17-4ef7-b340-0316979b55ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:51.506441 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d1498571-5a17-4ef7-b340-0316979b55ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:51.513331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d1498571-5a17-4ef7-b340-0316979b55ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:51.513771 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d1498571-5a17-4ef7-b340-0316979b55ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:51.514528 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d1498571-5a17-4ef7-b340-0316979b55ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:51.514957 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d1498571-5a17-4ef7-b340-0316979b55ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:51.568080 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a3afda75-dfb2-4cd4-a894-1da1d5fd200d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:51.568704 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a3afda75-dfb2-4cd4-a894-1da1d5fd200d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:51.575392 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3afda75-dfb2-4cd4-a894-1da1d5fd200d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:51.575850 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3afda75-dfb2-4cd4-a894-1da1d5fd200d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:51.576650 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3afda75-dfb2-4cd4-a894-1da1d5fd200d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:51.577271 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3afda75-dfb2-4cd4-a894-1da1d5fd200d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:51.581436 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:51.597823 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d1498571-5a17-4ef7-b340-0316979b55ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:51.609630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d1498571-5a17-4ef7-b340-0316979b55ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:51.611559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d1498571-5a17-4ef7-b340-0316979b55ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:51.612674 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d1498571-5a17-4ef7-b340-0316979b55ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1341 microversion: 2.20 time: 0.110858 Jul 28 06:42:51.613234 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 418/834] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:51 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1341 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:51.723403 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a3afda75-dfb2-4cd4-a894-1da1d5fd200d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:51.732193 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a3afda75-dfb2-4cd4-a894-1da1d5fd200d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1717 microversion: 2.1 time: 0.168413 Jul 28 06:42:51.733410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 417/835] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:51 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1717 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:42:51.845565 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0eb8eac5-b06a-415d-a537-e684033f99f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:51.846058 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0eb8eac5-b06a-415d-a537-e684033f99f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:51.853382 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0eb8eac5-b06a-415d-a537-e684033f99f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:51.853827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0eb8eac5-b06a-415d-a537-e684033f99f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:51.854598 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0eb8eac5-b06a-415d-a537-e684033f99f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:51.855009 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0eb8eac5-b06a-415d-a537-e684033f99f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:51.934809 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-0eb8eac5-b06a-415d-a537-e684033f99f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] HTTP exception thrown: Cannot 'detach_volume' instance 65a88fd0-386e-4cde-bddf-205dea943fc9 while it is in vm_state rescued Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0eb8eac5-b06a-415d-a537-e684033f99f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Request method failure captured: Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: DELETE /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments/b9647703-92d3-4a65-a7bd-0ad21cb4f872 HTTP/1.1 Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6gL3NkHM14I48tiw5dWARRiVlSX6hjzNDYLhrttt-VpWAx6eXR5kUxZBDUlxCkX-fjq73lfPcjtweW5Eo4lRq0y_dlqVzl41Z6FONmvJzGg1r1nfLlC1eo1-rYp9LQrqHOfMHzFaI4teQM8o0fNLhLpKdrVeIXiaMq8dsMMjOvMfQ Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: 0fb2f4ad616e43f5a9a248390bd0aebf Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:42:51.936424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fb2f4ad616e43f5a9a248390bd0aebf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fb2f4ad616e43f5a9a248390bd0aebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fb2f4ad616e43f5a9a248390bd0aebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fb2f4ad616e43f5a9a248390bd0aebf"}]}] Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: 0fb2f4ad616e43f5a9a248390bd0aebf Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-ServerRescueNegativeTestJSON-690058944-project Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: a2080efc6cbd471995593012bc268765 Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690058944-project Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:42:51.937927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Cannot 'detach_volume' instance 65a88fd0-386e-4cde-bddf-205dea943fc9 while it is in vm_state rescued Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'server_id': '65a88fd0-386e-4cde-bddf-205dea943fc9', 'id': 'b9647703-92d3-4a65-a7bd-0ad21cb4f872'} Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 65a88fd0-386e-4cde-bddf-205dea943fc9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:42:51.938763 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 65a88fd0-386e-4cde-bddf-205dea943fc9 while it is in vm_state rescued Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 65a88fd0-386e-4cde-bddf-205dea943fc9 while it is in vm_state rescued Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:42:51.940093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0eb8eac5-b06a-415d-a537-e684033f99f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Returning 409 to user: Cannot 'detach_volume' instance 65a88fd0-386e-4cde-bddf-205dea943fc9 while it is in vm_state rescued {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:42:51.941053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0eb8eac5-b06a-415d-a537-e684033f99f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments/b9647703-92d3-4a65-a7bd-0ad21cb4f872" status: 409 len: 152 microversion: 2.1 time: 0.096310 Jul 28 06:42:51.941053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 419/836] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:42:51 2022] DELETE /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments/b9647703-92d3-4a65-a7bd-0ad21cb4f872 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 06:42:51.948122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-aed7267c-3ff8-4375-9ac1-d94081b50d03 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:51.948658 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-aed7267c-3ff8-4375-9ac1-d94081b50d03 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:51.956633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aed7267c-3ff8-4375-9ac1-d94081b50d03 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:51.957082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aed7267c-3ff8-4375-9ac1-d94081b50d03 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:51.957886 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aed7267c-3ff8-4375-9ac1-d94081b50d03 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:51.959130 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aed7267c-3ff8-4375-9ac1-d94081b50d03 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:52.025519 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-aed7267c-3ff8-4375-9ac1-d94081b50d03 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "POST /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/action" status: 202 len: 0 microversion: 2.1 time: 0.081294 Jul 28 06:42:52.029034 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 418/837] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:42:51 2022] POST /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:42:52.034208 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b920ed11-390d-41f9-abb7-62456487a594 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:52.035059 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b920ed11-390d-41f9-abb7-62456487a594 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:52.042548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b920ed11-390d-41f9-abb7-62456487a594 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:52.043136 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b920ed11-390d-41f9-abb7-62456487a594 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:52.044349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b920ed11-390d-41f9-abb7-62456487a594 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:52.044709 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b920ed11-390d-41f9-abb7-62456487a594 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:52.255887 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b920ed11-390d-41f9-abb7-62456487a594 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:52.265093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b920ed11-390d-41f9-abb7-62456487a594 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1725 microversion: 2.1 time: 0.234417 Jul 28 06:42:52.266213 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 420/838] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:52 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:52.637965 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-13697f94-08d4-4c78-89a1-3a907597cc57 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:52.638665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-13697f94-08d4-4c78-89a1-3a907597cc57 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:52.652331 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-13697f94-08d4-4c78-89a1-3a907597cc57 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:52.653834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-13697f94-08d4-4c78-89a1-3a907597cc57 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:52.654750 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-13697f94-08d4-4c78-89a1-3a907597cc57 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:52.655285 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-13697f94-08d4-4c78-89a1-3a907597cc57 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:52.917279 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-13697f94-08d4-4c78-89a1-3a907597cc57 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:52.928553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-13697f94-08d4-4c78-89a1-3a907597cc57 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:52.930282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-13697f94-08d4-4c78-89a1-3a907597cc57 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:52.931511 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-13697f94-08d4-4c78-89a1-3a907597cc57 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.298369 Jul 28 06:42:52.932393 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 419/839] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:52 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:53.249976 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-7ed712ae-603c-42ab-a4ea-56e6a91da929 req-67b25a2d-262e-4cd8-b194-2db1c267edf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "163a335a-d407-4ec6-9c94-f0d8e37e83d4", "tag": "dc86c76c-8061-4d08-8a5f-ec9bba7801ad"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:53.262559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-7ed712ae-603c-42ab-a4ea-56e6a91da929 req-67b25a2d-262e-4cd8-b194-2db1c267edf2 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:53.263296 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-7ed712ae-603c-42ab-a4ea-56e6a91da929 req-67b25a2d-262e-4cd8-b194-2db1c267edf2 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:53.276057 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-7ed712ae-603c-42ab-a4ea-56e6a91da929 req-67b25a2d-262e-4cd8-b194-2db1c267edf2 service nova] Creating event network-changed:dc86c76c-8061-4d08-8a5f-ec9bba7801ad for instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 on hv-cinder-85060 Jul 28 06:42:53.281663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-7ed712ae-603c-42ab-a4ea-56e6a91da929 req-67b25a2d-262e-4cd8-b194-2db1c267edf2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035323 Jul 28 06:42:53.282253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 421/840] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:53.288045 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0521adef-879d-498e-8d99-b83d66074e75 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:53.288652 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0521adef-879d-498e-8d99-b83d66074e75 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:53.294798 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0521adef-879d-498e-8d99-b83d66074e75 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:53.295239 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0521adef-879d-498e-8d99-b83d66074e75 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:53.296006 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0521adef-879d-498e-8d99-b83d66074e75 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:53.296434 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0521adef-879d-498e-8d99-b83d66074e75 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:53.431102 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0521adef-879d-498e-8d99-b83d66074e75 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:53.439415 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0521adef-879d-498e-8d99-b83d66074e75 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1725 microversion: 2.1 time: 0.155625 Jul 28 06:42:53.439987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 420/841] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:53 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:53.956273 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e8505ba6-ffa6-40e2-9f7b-05d36b09c0be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:53.956981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e8505ba6-ffa6-40e2-9f7b-05d36b09c0be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:53.963809 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8505ba6-ffa6-40e2-9f7b-05d36b09c0be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:53.964260 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8505ba6-ffa6-40e2-9f7b-05d36b09c0be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:53.965019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8505ba6-ffa6-40e2-9f7b-05d36b09c0be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:53.965494 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8505ba6-ffa6-40e2-9f7b-05d36b09c0be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:54.101009 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e8505ba6-ffa6-40e2-9f7b-05d36b09c0be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:54.109546 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e8505ba6-ffa6-40e2-9f7b-05d36b09c0be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:54.111049 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e8505ba6-ffa6-40e2-9f7b-05d36b09c0be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:54.112144 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e8505ba6-ffa6-40e2-9f7b-05d36b09c0be tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.160633 Jul 28 06:42:54.112698 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 422/842] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:53 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:54.462082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b8c30b95-9f7b-411a-bceb-06b24c84fdad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:54.462687 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b8c30b95-9f7b-411a-bceb-06b24c84fdad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:54.469140 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b8c30b95-9f7b-411a-bceb-06b24c84fdad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:54.469617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b8c30b95-9f7b-411a-bceb-06b24c84fdad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:54.470371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b8c30b95-9f7b-411a-bceb-06b24c84fdad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:54.470797 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b8c30b95-9f7b-411a-bceb-06b24c84fdad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:54.597980 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b8c30b95-9f7b-411a-bceb-06b24c84fdad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:54.605899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b8c30b95-9f7b-411a-bceb-06b24c84fdad tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1725 microversion: 2.1 time: 0.148351 Jul 28 06:42:54.606446 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 421/843] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:54 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:55.134171 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-be38c10a-b6c7-45d4-a35d-0984ab6fdb4a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:55.134712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-be38c10a-b6c7-45d4-a35d-0984ab6fdb4a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:55.141183 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-be38c10a-b6c7-45d4-a35d-0984ab6fdb4a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:55.141661 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-be38c10a-b6c7-45d4-a35d-0984ab6fdb4a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:55.142412 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-be38c10a-b6c7-45d4-a35d-0984ab6fdb4a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:55.142842 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-be38c10a-b6c7-45d4-a35d-0984ab6fdb4a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:55.280438 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-be38c10a-b6c7-45d4-a35d-0984ab6fdb4a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:55.288799 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-be38c10a-b6c7-45d4-a35d-0984ab6fdb4a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:55.290306 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-be38c10a-b6c7-45d4-a35d-0984ab6fdb4a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:55.291390 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-be38c10a-b6c7-45d4-a35d-0984ab6fdb4a tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.161262 Jul 28 06:42:55.291940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 423/844] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:55 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:55.628782 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-20396f7e-12ba-4e8d-9801-063451e8af20 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:55.629434 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-20396f7e-12ba-4e8d-9801-063451e8af20 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:55.635915 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20396f7e-12ba-4e8d-9801-063451e8af20 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:55.636374 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20396f7e-12ba-4e8d-9801-063451e8af20 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:55.637148 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20396f7e-12ba-4e8d-9801-063451e8af20 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:55.637624 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20396f7e-12ba-4e8d-9801-063451e8af20 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:55.776125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-20396f7e-12ba-4e8d-9801-063451e8af20 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:55.784049 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-20396f7e-12ba-4e8d-9801-063451e8af20 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1731 microversion: 2.1 time: 0.159200 Jul 28 06:42:55.784617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 422/845] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:55 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:55.815796 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f750a301-da00-4c25-9d1f-fff01b304968 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:55.816299 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f750a301-da00-4c25-9d1f-fff01b304968 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:55.830291 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f750a301-da00-4c25-9d1f-fff01b304968 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:55.830911 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f750a301-da00-4c25-9d1f-fff01b304968 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:55.831729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f750a301-da00-4c25-9d1f-fff01b304968 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:55.832169 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f750a301-da00-4c25-9d1f-fff01b304968 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:55.936865 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f750a301-da00-4c25-9d1f-fff01b304968 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136260 Jul 28 06:42:55.937495 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 424/846] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Jul 28 06:42:55 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:56.314686 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d9d4ee5f-29d3-417d-a04c-a8a5556a4e5e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:56.315477 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d9d4ee5f-29d3-417d-a04c-a8a5556a4e5e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:56.322678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d9d4ee5f-29d3-417d-a04c-a8a5556a4e5e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:56.323121 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d9d4ee5f-29d3-417d-a04c-a8a5556a4e5e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:56.323880 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d9d4ee5f-29d3-417d-a04c-a8a5556a4e5e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:56.324328 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d9d4ee5f-29d3-417d-a04c-a8a5556a4e5e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:56.456816 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d9d4ee5f-29d3-417d-a04c-a8a5556a4e5e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:56.465640 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d9d4ee5f-29d3-417d-a04c-a8a5556a4e5e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:56.467140 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d9d4ee5f-29d3-417d-a04c-a8a5556a4e5e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:56.468250 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d9d4ee5f-29d3-417d-a04c-a8a5556a4e5e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.157537 Jul 28 06:42:56.468807 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 423/847] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:56 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:56.993200 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-75ab9645-b3f9-4e89-b4cb-26a43346ca36 req-536f1c03-195e-4e0b-b56a-410c243e02c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a88fd0-386e-4cde-bddf-205dea943fc9", "tag": "fd589bac-7a7d-4978-bdbb-17282786c967"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:57.002624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-75ab9645-b3f9-4e89-b4cb-26a43346ca36 req-536f1c03-195e-4e0b-b56a-410c243e02c3 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:57.003066 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-75ab9645-b3f9-4e89-b4cb-26a43346ca36 req-536f1c03-195e-4e0b-b56a-410c243e02c3 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:57.015023 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-75ab9645-b3f9-4e89-b4cb-26a43346ca36 req-536f1c03-195e-4e0b-b56a-410c243e02c3 service nova] Creating event network-changed:fd589bac-7a7d-4978-bdbb-17282786c967 for instance 65a88fd0-386e-4cde-bddf-205dea943fc9 on hv-cinder-85060 Jul 28 06:42:57.020073 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-75ab9645-b3f9-4e89-b4cb-26a43346ca36 req-536f1c03-195e-4e0b-b56a-410c243e02c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031706 Jul 28 06:42:57.022048 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 425/848] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:57.065848 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-16c9d4f0-11a2-4b95-9588-6a14d1b2d0a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-428082000"}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:57.066422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-16c9d4f0-11a2-4b95-9588-6a14d1b2d0a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:57.073907 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16c9d4f0-11a2-4b95-9588-6a14d1b2d0a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:57.074359 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16c9d4f0-11a2-4b95-9588-6a14d1b2d0a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:57.075125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16c9d4f0-11a2-4b95-9588-6a14d1b2d0a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:57.075560 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-16c9d4f0-11a2-4b95-9588-6a14d1b2d0a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:57.208007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.network.security_group_api [None req-16c9d4f0-11a2-4b95-9588-6a14d1b2d0a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Removing security group 5becbb74-1475-4908-8171-bfcddae7255c from port 547ddf0c-06c1-4016-890a-f31d53cfe707 Jul 28 06:42:57.493252 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-58312590-fafb-4da7-b339-7b97488f8020 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:57.494236 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-58312590-fafb-4da7-b339-7b97488f8020 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:57.502619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58312590-fafb-4da7-b339-7b97488f8020 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:57.503243 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58312590-fafb-4da7-b339-7b97488f8020 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:57.504189 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58312590-fafb-4da7-b339-7b97488f8020 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:57.504859 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58312590-fafb-4da7-b339-7b97488f8020 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:57.576594 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-16c9d4f0-11a2-4b95-9588-6a14d1b2d0a7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "POST /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/action" status: 202 len: 0 microversion: 2.1 time: 0.514579 Jul 28 06:42:57.577683 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 424/849] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:42:57 2022] POST /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:42:57.778841 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-07d89d06-aa6a-4d34-9cc8-45cc9a7c9a1b req-a32345a8-207d-48f9-b17b-9022feb4b5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9e64be-7751-4a35-9913-759b5aa65387", "tag": "547ddf0c-06c1-4016-890a-f31d53cfe707"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:57.790991 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-07d89d06-aa6a-4d34-9cc8-45cc9a7c9a1b req-a32345a8-207d-48f9-b17b-9022feb4b5ba service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:57.791440 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-07d89d06-aa6a-4d34-9cc8-45cc9a7c9a1b req-a32345a8-207d-48f9-b17b-9022feb4b5ba service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:57.809058 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-07d89d06-aa6a-4d34-9cc8-45cc9a7c9a1b req-a32345a8-207d-48f9-b17b-9022feb4b5ba service nova] Creating event network-changed:547ddf0c-06c1-4016-890a-f31d53cfe707 for instance 3e9e64be-7751-4a35-9913-759b5aa65387 on hv-cinder-85060 Jul 28 06:42:57.814486 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-07d89d06-aa6a-4d34-9cc8-45cc9a7c9a1b req-a32345a8-207d-48f9-b17b-9022feb4b5ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226517 Jul 28 06:42:57.817012 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 425/850] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:42:57.976846 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a6f8c616-a1fc-4cb4-94dd-91650a0d8503 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:57.977755 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a6f8c616-a1fc-4cb4-94dd-91650a0d8503 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:57.985236 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a6f8c616-a1fc-4cb4-94dd-91650a0d8503 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:57.986010 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a6f8c616-a1fc-4cb4-94dd-91650a0d8503 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:57.987001 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a6f8c616-a1fc-4cb4-94dd-91650a0d8503 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:57.987601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a6f8c616-a1fc-4cb4-94dd-91650a0d8503 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:58.017098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a6f8c616-a1fc-4cb4-94dd-91650a0d8503 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:42:58.120259 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-58312590-fafb-4da7-b339-7b97488f8020 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:58.129629 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-58312590-fafb-4da7-b339-7b97488f8020 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:58.136404 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-58312590-fafb-4da7-b339-7b97488f8020 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:58.143434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-58312590-fafb-4da7-b339-7b97488f8020 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.655125 Jul 28 06:42:58.158980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 426/851] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:57 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:58.186455 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a6f8c616-a1fc-4cb4-94dd-91650a0d8503 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 204 len: 0 microversion: 2.1 time: 0.213809 Jul 28 06:42:58.188506 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 426/852] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:42:57 2022] DELETE /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 06:42:58.197801 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5916936a-e841-4b4b-b9e5-2e59a1c67598 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:58.198432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5916936a-e841-4b4b-b9e5-2e59a1c67598 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:58.204420 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5916936a-e841-4b4b-b9e5-2e59a1c67598 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:58.204875 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5916936a-e841-4b4b-b9e5-2e59a1c67598 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:58.205682 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5916936a-e841-4b4b-b9e5-2e59a1c67598 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:58.206123 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5916936a-e841-4b4b-b9e5-2e59a1c67598 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:58.379602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5916936a-e841-4b4b-b9e5-2e59a1c67598 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:58.388615 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5916936a-e841-4b4b-b9e5-2e59a1c67598 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1577 microversion: 2.1 time: 0.196047 Jul 28 06:42:58.389584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 427/853] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:58 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:59.035845 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-a93e078f-84a7-4408-b574-be15ea405f21 req-9c4169b9-e69a-45a3-814b-204f265ca0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a88fd0-386e-4cde-bddf-205dea943fc9", "tag": "fd589bac-7a7d-4978-bdbb-17282786c967"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:59.045668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-a93e078f-84a7-4408-b574-be15ea405f21 req-9c4169b9-e69a-45a3-814b-204f265ca0c6 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:59.046193 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-a93e078f-84a7-4408-b574-be15ea405f21 req-9c4169b9-e69a-45a3-814b-204f265ca0c6 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:59.057876 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-a93e078f-84a7-4408-b574-be15ea405f21 req-9c4169b9-e69a-45a3-814b-204f265ca0c6 service nova] Creating event network-changed:fd589bac-7a7d-4978-bdbb-17282786c967 for instance 65a88fd0-386e-4cde-bddf-205dea943fc9 on hv-cinder-85060 Jul 28 06:42:59.062712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-a93e078f-84a7-4408-b574-be15ea405f21 req-9c4169b9-e69a-45a3-814b-204f265ca0c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030982 Jul 28 06:42:59.063591 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 427/854] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:59.170683 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-45bd2deb-d3fd-4c77-9c6b-9ebd19bb83e0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:59.171386 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-45bd2deb-d3fd-4c77-9c6b-9ebd19bb83e0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:59.178167 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-45bd2deb-d3fd-4c77-9c6b-9ebd19bb83e0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:59.178621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-45bd2deb-d3fd-4c77-9c6b-9ebd19bb83e0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:59.179395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-45bd2deb-d3fd-4c77-9c6b-9ebd19bb83e0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:59.180010 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-45bd2deb-d3fd-4c77-9c6b-9ebd19bb83e0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:59.197023 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:59.198187 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:59.219121 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7c54bb6e-6397-406a-8b3e-0f372f444c9c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:59.219834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7c54bb6e-6397-406a-8b3e-0f372f444c9c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:59.228384 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7c54bb6e-6397-406a-8b3e-0f372f444c9c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:59.228830 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7c54bb6e-6397-406a-8b3e-0f372f444c9c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:59.229972 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7c54bb6e-6397-406a-8b3e-0f372f444c9c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:59.230411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7c54bb6e-6397-406a-8b3e-0f372f444c9c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:59.320211 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-7c54bb6e-6397-406a-8b3e-0f372f444c9c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lazy-loading 'services' on Instance uuid 3e9e64be-7751-4a35-9913-759b5aa65387 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:42:59.325035 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-45bd2deb-d3fd-4c77-9c6b-9ebd19bb83e0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:59.334331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-45bd2deb-d3fd-4c77-9c6b-9ebd19bb83e0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:59.335881 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-45bd2deb-d3fd-4c77-9c6b-9ebd19bb83e0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:59.337201 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-45bd2deb-d3fd-4c77-9c6b-9ebd19bb83e0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.170412 Jul 28 06:42:59.338261 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 428/855] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:42:59 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:42:59.398641 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7c54bb6e-6397-406a-8b3e-0f372f444c9c tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments/2ca8756a-b9c1-46fc-b64d-2e32816dfa30" status: 202 len: 0 microversion: 2.1 time: 0.183361 Jul 28 06:42:59.402513 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 428/856] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:42:59 2022] DELETE /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments/2ca8756a-b9c1-46fc-b64d-2e32816dfa30 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:42:59.407598 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-39ad9b6f-7765-479a-b2bd-26ed939c5c9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:59.414779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cc5d5916-0c53-420d-9a82-3de5e18d5300 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:59.415478 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cc5d5916-0c53-420d-9a82-3de5e18d5300 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:59.419752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-39ad9b6f-7765-479a-b2bd-26ed939c5c9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:59.421654 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=12 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:59.422451 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc5d5916-0c53-420d-9a82-3de5e18d5300 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:59.422967 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc5d5916-0c53-420d-9a82-3de5e18d5300 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:59.424235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc5d5916-0c53-420d-9a82-3de5e18d5300 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:59.425172 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc5d5916-0c53-420d-9a82-3de5e18d5300 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:59.427510 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-39ad9b6f-7765-479a-b2bd-26ed939c5c9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:59.427970 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-39ad9b6f-7765-479a-b2bd-26ed939c5c9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:59.428758 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-39ad9b6f-7765-479a-b2bd-26ed939c5c9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:59.429194 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-39ad9b6f-7765-479a-b2bd-26ed939c5c9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:59.466087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-39ad9b6f-7765-479a-b2bd-26ed939c5c9d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062347 Jul 28 06:42:59.467315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 429/857] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:42:59 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:59.622843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cc5d5916-0c53-420d-9a82-3de5e18d5300 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:59.636178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cc5d5916-0c53-420d-9a82-3de5e18d5300 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1577 microversion: 2.1 time: 0.225882 Jul 28 06:42:59.637054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 429/858] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:59 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:59.840277 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-fa6bdd0d-b62f-4edd-be40-973f298d17b1 req-af294727-44bb-4694-819f-6c2cbee9d961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9e64be-7751-4a35-9913-759b5aa65387", "tag": "547ddf0c-06c1-4016-890a-f31d53cfe707"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:59.849982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-fa6bdd0d-b62f-4edd-be40-973f298d17b1 req-af294727-44bb-4694-819f-6c2cbee9d961 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:59.850422 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-fa6bdd0d-b62f-4edd-be40-973f298d17b1 req-af294727-44bb-4694-819f-6c2cbee9d961 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:59.861223 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-fa6bdd0d-b62f-4edd-be40-973f298d17b1 req-af294727-44bb-4694-819f-6c2cbee9d961 service nova] Creating event network-changed:547ddf0c-06c1-4016-890a-f31d53cfe707 for instance 3e9e64be-7751-4a35-9913-759b5aa65387 on hv-cinder-85060 Jul 28 06:42:59.866756 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-fa6bdd0d-b62f-4edd-be40-973f298d17b1 req-af294727-44bb-4694-819f-6c2cbee9d961 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030201 Jul 28 06:42:59.867331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 430/859] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:00.360759 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-fd121089-140b-4ca4-903c-fcec8083b8d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:00.361456 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-fd121089-140b-4ca4-903c-fcec8083b8d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:00.366626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:00.370568 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd121089-140b-4ca4-903c-fcec8083b8d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:00.371028 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd121089-140b-4ca4-903c-fcec8083b8d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:00.371806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd121089-140b-4ca4-903c-fcec8083b8d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:00.372243 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fd121089-140b-4ca4-903c-fcec8083b8d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:00.480639 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-fa238f05-2afa-497b-a6fa-8b8d0b4ff6eb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:00.482890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-fa238f05-2afa-497b-a6fa-8b8d0b4ff6eb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:00.491416 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa238f05-2afa-497b-a6fa-8b8d0b4ff6eb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:00.491868 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa238f05-2afa-497b-a6fa-8b8d0b4ff6eb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:00.492646 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa238f05-2afa-497b-a6fa-8b8d0b4ff6eb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:00.493273 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fa238f05-2afa-497b-a6fa-8b8d0b4ff6eb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:00.526539 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-fa238f05-2afa-497b-a6fa-8b8d0b4ff6eb tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049980 Jul 28 06:43:00.527413 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 431/860] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:43:00 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:43:00.537456 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-fd121089-140b-4ca4-903c-fcec8083b8d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:00.545725 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-fd121089-140b-4ca4-903c-fcec8083b8d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:00.547230 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-fd121089-140b-4ca4-903c-fcec8083b8d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:00.548331 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-fd121089-140b-4ca4-903c-fcec8083b8d6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.191727 Jul 28 06:43:00.549066 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 430/861] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:00 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:43:00.666375 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-722ab1de-a2f7-472b-adda-3b2d5ba6035a tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:00.667225 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-722ab1de-a2f7-472b-adda-3b2d5ba6035a tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:00.673538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-722ab1de-a2f7-472b-adda-3b2d5ba6035a tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:00.674053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-722ab1de-a2f7-472b-adda-3b2d5ba6035a tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:00.675082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-722ab1de-a2f7-472b-adda-3b2d5ba6035a tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:00.675678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-722ab1de-a2f7-472b-adda-3b2d5ba6035a tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:00.834028 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-722ab1de-a2f7-472b-adda-3b2d5ba6035a tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:00.842412 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-722ab1de-a2f7-472b-adda-3b2d5ba6035a tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1577 microversion: 2.1 time: 0.181853 Jul 28 06:43:00.843189 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 432/862] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:00 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:01.538952 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7720ea97-cab3-4ec2-b18f-5d20a8f5b27a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:01.541163 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7720ea97-cab3-4ec2-b18f-5d20a8f5b27a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:01.548098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7720ea97-cab3-4ec2-b18f-5d20a8f5b27a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:01.548547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7720ea97-cab3-4ec2-b18f-5d20a8f5b27a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:01.549353 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7720ea97-cab3-4ec2-b18f-5d20a8f5b27a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:01.549792 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7720ea97-cab3-4ec2-b18f-5d20a8f5b27a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:01.572715 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8116c90c-0f2c-4fd1-bebf-2813b9407c21 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:01.573746 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8116c90c-0f2c-4fd1-bebf-2813b9407c21 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:01.580368 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8116c90c-0f2c-4fd1-bebf-2813b9407c21 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:01.580822 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8116c90c-0f2c-4fd1-bebf-2813b9407c21 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:01.581636 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8116c90c-0f2c-4fd1-bebf-2813b9407c21 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:01.581946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7720ea97-cab3-4ec2-b18f-5d20a8f5b27a tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047562 Jul 28 06:43:01.582095 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8116c90c-0f2c-4fd1-bebf-2813b9407c21 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:01.582812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 431/863] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:43:01 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:43:01.593139 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4b2af62a-69a0-4d07-bceb-fbdb19486c61 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:01.593708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4b2af62a-69a0-4d07-bceb-fbdb19486c61 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:01.601007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4b2af62a-69a0-4d07-bceb-fbdb19486c61 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:01.601491 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4b2af62a-69a0-4d07-bceb-fbdb19486c61 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:01.602277 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4b2af62a-69a0-4d07-bceb-fbdb19486c61 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:01.603022 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4b2af62a-69a0-4d07-bceb-fbdb19486c61 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:01.607373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:01.690643 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-4b2af62a-69a0-4d07-bceb-fbdb19486c61 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] HTTP exception thrown: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 is not attached to volume 2ca8756a-b9c1-46fc-b64d-2e32816dfa30 Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4b2af62a-69a0-4d07-bceb-fbdb19486c61 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Request method failure captured: Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments/2ca8756a-b9c1-46fc-b64d-2e32816dfa30 HTTP/1.1 Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i8Yaz_6wvsjWByxyzbgZTtfmq0L3xLP7Iom_Oy8baStEL_eNQ9EkGKrmKaNokYAXKpeARnAkEfR4UR4YKJcMPc8UMkQ9npbNhcQ0enuR6BqCbIlMD_49JSV2jXQy8_f0tqesffBlMg3hrxtGfs7PwYwglbqPsCCYwPZ0hSxmwceMUo Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: 6b7e4c91aaaf48e2b134128055919a47 Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-TestMinimumBasicScenario-617398025 Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:43:01.700502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6b7e4c91aaaf48e2b134128055919a47", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6b7e4c91aaaf48e2b134128055919a47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6b7e4c91aaaf48e2b134128055919a47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6b7e4c91aaaf48e2b134128055919a47"}]}] Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-TestMinimumBasicScenario-617398025 Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: 6b7e4c91aaaf48e2b134128055919a47 Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-TestMinimumBasicScenario-617398025 Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-TestMinimumBasicScenario-617398025-project Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 93dacbaabf7343bbae337761b8d8cd41 Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-TestMinimumBasicScenario-617398025-project Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:43:01.702025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 is not attached to volume 2ca8756a-b9c1-46fc-b64d-2e32816dfa30 Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'server_id': '3e9e64be-7751-4a35-9913-759b5aa65387', 'id': '2ca8756a-b9c1-46fc-b64d-2e32816dfa30'} Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2ca8756a-b9c1-46fc-b64d-2e32816dfa30. Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:43:01.702780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 is not attached to volume 2ca8756a-b9c1-46fc-b64d-2e32816dfa30 Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 is not attached to volume 2ca8756a-b9c1-46fc-b64d-2e32816dfa30 Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:01.704031 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4b2af62a-69a0-4d07-bceb-fbdb19486c61 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Returning 404 to user: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 is not attached to volume 2ca8756a-b9c1-46fc-b64d-2e32816dfa30 {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:43:01.704995 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4b2af62a-69a0-4d07-bceb-fbdb19486c61 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments/2ca8756a-b9c1-46fc-b64d-2e32816dfa30" status: 404 len: 154 microversion: 2.1 time: 0.113021 Jul 28 06:43:01.706451 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 432/864] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:43:01 2022] DELETE /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387/os-volume_attachments/2ca8756a-b9c1-46fc-b64d-2e32816dfa30 => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:43:01.737749 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8116c90c-0f2c-4fd1-bebf-2813b9407c21 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:01.748098 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8116c90c-0f2c-4fd1-bebf-2813b9407c21 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:01.749764 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8116c90c-0f2c-4fd1-bebf-2813b9407c21 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:01.751183 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8116c90c-0f2c-4fd1-bebf-2813b9407c21 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.182306 Jul 28 06:43:01.751969 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 433/865] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:01 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:43:01.865455 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a7c4002c-ca42-42a9-8529-ece45e1e8327 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:01.866161 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a7c4002c-ca42-42a9-8529-ece45e1e8327 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:01.872324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a7c4002c-ca42-42a9-8529-ece45e1e8327 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:01.872848 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a7c4002c-ca42-42a9-8529-ece45e1e8327 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:01.873797 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a7c4002c-ca42-42a9-8529-ece45e1e8327 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:01.874319 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a7c4002c-ca42-42a9-8529-ece45e1e8327 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:02.023033 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a7c4002c-ca42-42a9-8529-ece45e1e8327 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:02.030681 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a7c4002c-ca42-42a9-8529-ece45e1e8327 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1509 microversion: 2.1 time: 0.169769 Jul 28 06:43:02.031271 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 433/866] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:01 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:02.570521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-8ac2785f-fa9e-40e9-9394-46f621ace349 req-ad8b7337-56e3-4545-971f-5fa42604b446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a882b29e-1e41-4e8d-a8ed-7cdd735d175e", "name": "network-vif-deleted", "tag": "f779dd90-25ac-4b48-b542-655c148fc093"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:02.586344 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-8ac2785f-fa9e-40e9-9394-46f621ace349 req-ad8b7337-56e3-4545-971f-5fa42604b446 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:02.589193 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-8ac2785f-fa9e-40e9-9394-46f621ace349 req-ad8b7337-56e3-4545-971f-5fa42604b446 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:02.602616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-8ac2785f-fa9e-40e9-9394-46f621ace349 req-ad8b7337-56e3-4545-971f-5fa42604b446 service nova] Creating event network-vif-deleted:f779dd90-25ac-4b48-b542-655c148fc093 for instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e on hv-cinder-85060 Jul 28 06:43:02.607847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-8ac2785f-fa9e-40e9-9394-46f621ace349 req-ad8b7337-56e3-4545-971f-5fa42604b446 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041494 Jul 28 06:43:02.608702 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 434/867] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:02.774612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-f8434791-0998-4553-ab36-f1ef810192ad req-a526cd6d-4482-4e8d-8678-42ecfb7d1cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163a335a-d407-4ec6-9c94-f0d8e37e83d4", "name": "network-vif-plugged", "status": "completed", "tag": "dc86c76c-8061-4d08-8a5f-ec9bba7801ad"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:02.779669 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3a51441f-4d85-4814-8c1b-ee46fbd9c84c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:02.780365 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3a51441f-4d85-4814-8c1b-ee46fbd9c84c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:02.789331 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-f8434791-0998-4553-ab36-f1ef810192ad req-a526cd6d-4482-4e8d-8678-42ecfb7d1cd5 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:02.789853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-f8434791-0998-4553-ab36-f1ef810192ad req-a526cd6d-4482-4e8d-8678-42ecfb7d1cd5 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:02.797270 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3a51441f-4d85-4814-8c1b-ee46fbd9c84c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:02.797753 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3a51441f-4d85-4814-8c1b-ee46fbd9c84c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:02.799872 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3a51441f-4d85-4814-8c1b-ee46fbd9c84c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:02.800891 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3a51441f-4d85-4814-8c1b-ee46fbd9c84c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:02.804409 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-f8434791-0998-4553-ab36-f1ef810192ad req-a526cd6d-4482-4e8d-8678-42ecfb7d1cd5 service nova] Creating event network-vif-plugged:dc86c76c-8061-4d08-8a5f-ec9bba7801ad for instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 on hv-cinder-85060 Jul 28 06:43:02.809854 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-f8434791-0998-4553-ab36-f1ef810192ad req-a526cd6d-4482-4e8d-8678-42ecfb7d1cd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129145 Jul 28 06:43:02.810647 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 434/868] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:02.858165 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4538cd04-5715-4796-9cd7-f7a34d7f854d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:02.858752 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4538cd04-5715-4796-9cd7-f7a34d7f854d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:02.866322 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4538cd04-5715-4796-9cd7-f7a34d7f854d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:02.866780 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4538cd04-5715-4796-9cd7-f7a34d7f854d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:02.867592 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4538cd04-5715-4796-9cd7-f7a34d7f854d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:02.868467 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4538cd04-5715-4796-9cd7-f7a34d7f854d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:02.907305 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4538cd04-5715-4796-9cd7-f7a34d7f854d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:43:02.972172 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3a51441f-4d85-4814-8c1b-ee46fbd9c84c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:02.982580 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3a51441f-4d85-4814-8c1b-ee46fbd9c84c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:02.984085 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3a51441f-4d85-4814-8c1b-ee46fbd9c84c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:02.985220 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3a51441f-4d85-4814-8c1b-ee46fbd9c84c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.209823 Jul 28 06:43:02.988122 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 435/869] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:02 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:43:03.027652 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4538cd04-5715-4796-9cd7-f7a34d7f854d tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 204 len: 0 microversion: 2.1 time: 0.174202 Jul 28 06:43:03.038281 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a0464686-c8d5-4c97-a39a-94ff1a96aa3b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:03.038900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a0464686-c8d5-4c97-a39a-94ff1a96aa3b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:03.041386 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 435/870] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:43:02 2022] DELETE /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:43:03.045450 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0464686-c8d5-4c97-a39a-94ff1a96aa3b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:03.045934 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0464686-c8d5-4c97-a39a-94ff1a96aa3b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:03.046904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0464686-c8d5-4c97-a39a-94ff1a96aa3b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:03.047496 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0464686-c8d5-4c97-a39a-94ff1a96aa3b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:03.060480 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5f2857e2-310b-4147-b77b-04ba5c18491b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:03.061209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5f2857e2-310b-4147-b77b-04ba5c18491b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:03.071372 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5f2857e2-310b-4147-b77b-04ba5c18491b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:03.071840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5f2857e2-310b-4147-b77b-04ba5c18491b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:03.072657 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5f2857e2-310b-4147-b77b-04ba5c18491b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:03.073676 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5f2857e2-310b-4147-b77b-04ba5c18491b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:03.146138 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5f2857e2-310b-4147-b77b-04ba5c18491b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:03.153898 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5f2857e2-310b-4147-b77b-04ba5c18491b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1225 microversion: 2.1 time: 0.104522 Jul 28 06:43:03.154713 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 436/871] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:03 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:03.202903 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a0464686-c8d5-4c97-a39a-94ff1a96aa3b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:03.211697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a0464686-c8d5-4c97-a39a-94ff1a96aa3b tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1554 microversion: 2.1 time: 0.178065 Jul 28 06:43:03.212402 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 436/872] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:03 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:04.009271 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cf270a10-19a0-410c-a280-676da0916ced tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:04.009907 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cf270a10-19a0-410c-a280-676da0916ced tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:04.016329 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cf270a10-19a0-410c-a280-676da0916ced tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:04.016775 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cf270a10-19a0-410c-a280-676da0916ced tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:04.017582 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cf270a10-19a0-410c-a280-676da0916ced tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:04.018016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cf270a10-19a0-410c-a280-676da0916ced tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:04.148452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cf270a10-19a0-410c-a280-676da0916ced tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:04.156370 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cf270a10-19a0-410c-a280-676da0916ced tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:04.157939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cf270a10-19a0-410c-a280-676da0916ced tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:04.159044 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cf270a10-19a0-410c-a280-676da0916ced tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.154884 Jul 28 06:43:04.159607 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 437/873] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:04 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:43:04.175637 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:04.176249 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:04.183943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:04.184400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:04.185158 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:04.185616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:04.218154 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:04.218602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:04.219041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lazy-loading 'fault' on Instance uuid a882b29e-1e41-4e8d-a8ed-7cdd735d175e {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:43:04.233413 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6c63a499-31e2-4949-a64e-5c6bf5ccb322 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:04.234030 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6c63a499-31e2-4949-a64e-5c6bf5ccb322 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:04.240370 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6c63a499-31e2-4949-a64e-5c6bf5ccb322 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:04.240828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6c63a499-31e2-4949-a64e-5c6bf5ccb322 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:04.241639 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6c63a499-31e2-4949-a64e-5c6bf5ccb322 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:04.242082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6c63a499-31e2-4949-a64e-5c6bf5ccb322 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:04.260376 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:04.267827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a9316163-1b91-4471-8b7c-c2fd70a1b43c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1230 microversion: 2.1 time: 0.096018 Jul 28 06:43:04.268402 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 437/874] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:04 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:04.370708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6c63a499-31e2-4949-a64e-5c6bf5ccb322 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:04.378150 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6c63a499-31e2-4949-a64e-5c6bf5ccb322 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1554 microversion: 2.1 time: 0.148610 Jul 28 06:43:04.378714 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 438/875] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:04 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:05.183203 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-415e9b2c-3e18-4eeb-a2aa-0711422571e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:05.183833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-415e9b2c-3e18-4eeb-a2aa-0711422571e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:05.190295 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-415e9b2c-3e18-4eeb-a2aa-0711422571e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:05.190744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-415e9b2c-3e18-4eeb-a2aa-0711422571e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:05.191567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-415e9b2c-3e18-4eeb-a2aa-0711422571e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:05.191955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-415e9b2c-3e18-4eeb-a2aa-0711422571e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:05.291444 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:05.292061 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:05.298623 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:05.299072 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:05.299834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:05.300269 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:05.321570 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-415e9b2c-3e18-4eeb-a2aa-0711422571e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:05.329490 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-415e9b2c-3e18-4eeb-a2aa-0711422571e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:05.331013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-415e9b2c-3e18-4eeb-a2aa-0711422571e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:05.331910 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:05.332114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-415e9b2c-3e18-4eeb-a2aa-0711422571e4 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.152866 Jul 28 06:43:05.332369 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:05.332807 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 438/876] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:05 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:43:05.332983 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lazy-loading 'fault' on Instance uuid a882b29e-1e41-4e8d-a8ed-7cdd735d175e {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:43:05.373966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:05.381354 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cfb5a2db-0849-4460-b187-c17de837371b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1230 microversion: 2.1 time: 0.093723 Jul 28 06:43:05.381919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 439/877] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:05 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:05.399718 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-443a2324-df48-4731-a98f-fe731f0e09c7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:05.400333 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-443a2324-df48-4731-a98f-fe731f0e09c7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:05.406339 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-443a2324-df48-4731-a98f-fe731f0e09c7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:05.406795 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-443a2324-df48-4731-a98f-fe731f0e09c7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:05.407555 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-443a2324-df48-4731-a98f-fe731f0e09c7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:05.407994 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-443a2324-df48-4731-a98f-fe731f0e09c7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:05.552390 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-443a2324-df48-4731-a98f-fe731f0e09c7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:05.560094 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-443a2324-df48-4731-a98f-fe731f0e09c7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1554 microversion: 2.1 time: 0.164264 Jul 28 06:43:05.560663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 439/878] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:05 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:06.355379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-43c6c779-1e86-4cc4-97f4-11fc106f60f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:06.355975 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-43c6c779-1e86-4cc4-97f4-11fc106f60f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:06.362495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43c6c779-1e86-4cc4-97f4-11fc106f60f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:06.362950 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43c6c779-1e86-4cc4-97f4-11fc106f60f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:06.364247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43c6c779-1e86-4cc4-97f4-11fc106f60f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:06.364944 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-43c6c779-1e86-4cc4-97f4-11fc106f60f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:06.401840 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:06.402547 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:06.409520 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:06.410297 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:06.411302 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:06.411738 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:06.447618 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:06.448179 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:06.448706 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lazy-loading 'fault' on Instance uuid a882b29e-1e41-4e8d-a8ed-7cdd735d175e {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:43:06.490361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:06.497820 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-af13fb63-f99e-4aa3-955e-a1f742535389 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 200 len: 1230 microversion: 2.1 time: 0.099783 Jul 28 06:43:06.498400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 440/879] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:06 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:06.537786 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-43c6c779-1e86-4cc4-97f4-11fc106f60f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:06.546002 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-43c6c779-1e86-4cc4-97f4-11fc106f60f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:06.547513 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-43c6c779-1e86-4cc4-97f4-11fc106f60f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:06.548613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-43c6c779-1e86-4cc4-97f4-11fc106f60f9 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1406 microversion: 2.20 time: 0.197258 Jul 28 06:43:06.549177 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 440/880] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:06 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:43:06.582016 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-71764f0d-ab07-42fc-9453-a7a5b1f0591e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:06.583159 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-71764f0d-ab07-42fc-9453-a7a5b1f0591e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:06.589518 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71764f0d-ab07-42fc-9453-a7a5b1f0591e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:06.589971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71764f0d-ab07-42fc-9453-a7a5b1f0591e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:06.591094 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71764f0d-ab07-42fc-9453-a7a5b1f0591e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:06.591539 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71764f0d-ab07-42fc-9453-a7a5b1f0591e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:06.737017 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-71764f0d-ab07-42fc-9453-a7a5b1f0591e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:06.744789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-71764f0d-ab07-42fc-9453-a7a5b1f0591e tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1554 microversion: 2.1 time: 0.167078 Jul 28 06:43:06.751243 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 441/881] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:06 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:06.997576 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-e7e54d23-2d1f-4f9d-a9a4-f3364924dffb req-9c2c828c-63dc-44c7-a25c-628506346933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9e64be-7751-4a35-9913-759b5aa65387", "name": "network-vif-deleted", "tag": "547ddf0c-06c1-4016-890a-f31d53cfe707"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:07.007440 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-e7e54d23-2d1f-4f9d-a9a4-f3364924dffb req-9c2c828c-63dc-44c7-a25c-628506346933 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:07.007884 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-e7e54d23-2d1f-4f9d-a9a4-f3364924dffb req-9c2c828c-63dc-44c7-a25c-628506346933 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:07.018716 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-e7e54d23-2d1f-4f9d-a9a4-f3364924dffb req-9c2c828c-63dc-44c7-a25c-628506346933 service nova] Creating event network-vif-deleted:547ddf0c-06c1-4016-890a-f31d53cfe707 for instance 3e9e64be-7751-4a35-9913-759b5aa65387 on hv-cinder-85060 Jul 28 06:43:07.023991 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-e7e54d23-2d1f-4f9d-a9a4-f3364924dffb req-9c2c828c-63dc-44c7-a25c-628506346933 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030166 Jul 28 06:43:07.024569 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 441/882] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:07.518690 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4de981ca-0991-40ee-b8af-3314a8247fbe tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:07.519402 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4de981ca-0991-40ee-b8af-3314a8247fbe tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:07.526742 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4de981ca-0991-40ee-b8af-3314a8247fbe tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:07.527314 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4de981ca-0991-40ee-b8af-3314a8247fbe tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:07.528116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4de981ca-0991-40ee-b8af-3314a8247fbe tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:07.528567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4de981ca-0991-40ee-b8af-3314a8247fbe tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:07.542468 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-4de981ca-0991-40ee-b8af-3314a8247fbe tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] HTTP exception thrown: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4de981ca-0991-40ee-b8af-3314a8247fbe tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Request method failure captured: Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e HTTP/1.1 Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i727NE_YihrH1h93rv2sYUjSQ_0m676rbIX-7yuYs2YEoxBGgFb8S3pe1_KIKIPaubCDk7S0G_AOryRJkCigRf2neCEWVWK-O5cXxQ2ncj_ILLfozUX794si0Y-Mqpe6hq7n3D1ctO5M-VsaTIuV_wF_b51OCMAFntb2tHnOVEpbQk Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: f16eee0fb716452e8c760a27b5724d91 Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-TestVolumeBootPattern-281232211 Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:43:07.544099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f16eee0fb716452e8c760a27b5724d91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f16eee0fb716452e8c760a27b5724d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f16eee0fb716452e8c760a27b5724d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f16eee0fb716452e8c760a27b5724d91"}]}] Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-TestVolumeBootPattern-281232211 Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: f16eee0fb716452e8c760a27b5724d91 Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-TestVolumeBootPattern-281232211 Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-TestVolumeBootPattern-281232211-project Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 13ca4be686f84c279f87016c20129833 Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-TestVolumeBootPattern-281232211-project Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:43:07.545770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': 'a882b29e-1e41-4e8d-a8ed-7cdd735d175e'} Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:43:07.546691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:43:07.548053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:07.549367 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4de981ca-0991-40ee-b8af-3314a8247fbe tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Returning 404 to user: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:43:07.549367 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4de981ca-0991-40ee-b8af-3314a8247fbe tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 404 len: 111 microversion: 2.1 time: 0.030839 Jul 28 06:43:07.549367 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 442/883] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:07 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:43:07.573407 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ad267409-ffe9-4353-8944-1e395fff6e07 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:07.574198 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ad267409-ffe9-4353-8944-1e395fff6e07 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:07.580556 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ad267409-ffe9-4353-8944-1e395fff6e07 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:07.581008 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ad267409-ffe9-4353-8944-1e395fff6e07 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:07.581801 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ad267409-ffe9-4353-8944-1e395fff6e07 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:07.582234 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ad267409-ffe9-4353-8944-1e395fff6e07 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:07.650830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-429608372", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-306828582", "security_groups": [{"name": "tempest-secgroup-smoke-1325947969"}], "block_device_mapping_v2": [{"uuid": "985dc747-f06a-429e-9a46-b52e1b69c955", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eec19e8-2941-4311-8a4f-2b98c90d5895"}]}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:07.722580 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ad267409-ffe9-4353-8944-1e395fff6e07 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:07.731448 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ad267409-ffe9-4353-8944-1e395fff6e07 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:07.733064 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ad267409-ffe9-4353-8944-1e395fff6e07 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:07.734367 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ad267409-ffe9-4353-8944-1e395fff6e07 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1598 microversion: 2.20 time: 0.167134 Jul 28 06:43:07.735086 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 442/884] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:07 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:43:07.764459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d663b829-ca4d-46ae-ae5d-3d371c7f28d0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:07.764878 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d663b829-ca4d-46ae-ae5d-3d371c7f28d0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:07.771918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d663b829-ca4d-46ae-ae5d-3d371c7f28d0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:07.772734 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d663b829-ca4d-46ae-ae5d-3d371c7f28d0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:07.773389 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] validate_networks() for [('5eec19e8-2941-4311-8a4f-2b98c90d5895', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:43:07.774116 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d663b829-ca4d-46ae-ae5d-3d371c7f28d0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:07.774931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d663b829-ca4d-46ae-ae5d-3d371c7f28d0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:07.857269 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d663b829-ca4d-46ae-ae5d-3d371c7f28d0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103593 Jul 28 06:43:07.857928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 443/885] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Jul 28 06:43:07 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:43:07.870279 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:07.870914 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:07.877138 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:07.877627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:07.878399 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:07.879046 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:07.929470 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:07.930243 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:07.931099 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lazy-loading 'fault' on Instance uuid 3e9e64be-7751-4a35-9913-759b5aa65387 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:43:07.980536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dacbaabf7343bbae337761b8d8cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7e4c91aaaf48e2b134128055919a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:07.987825 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cc8ab4be-28ce-40cd-93d3-cb7302fad4d4 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 200 len: 1348 microversion: 2.1 time: 0.121063 Jul 28 06:43:07.990453 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 444/886] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:07 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 1348 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:08.492751 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:43:08.493253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:43:08.493822 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:43:08.494297 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:43:08.494776 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:43:08.503687 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:08.504131 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:08.511709 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:08.512341 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:08.530454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Getting quotas for project f16eee0fb716452e8c760a27b5724d91. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:43:08.534759 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Getting quotas for user 13ca4be686f84c279f87016c20129833 and project f16eee0fb716452e8c760a27b5724d91. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:43:08.593896 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:43:08.595993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='985dc747-f06a-429e-9a46-b52e1b69c955',volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:43:08.731174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-055e0a3f-f82c-4d3b-b347-cb2510b8f828 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.084136 Jul 28 06:43:08.731883 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 443/887] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:43:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 06:43:08.744907 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1513cd98-0b72-4f72-8a9f-fe957d8a44e5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:08.745545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1513cd98-0b72-4f72-8a9f-fe957d8a44e5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:08.821347 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1513cd98-0b72-4f72-8a9f-fe957d8a44e5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:08.828527 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1513cd98-0b72-4f72-8a9f-fe957d8a44e5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1093 microversion: 2.1 time: 0.089015 Jul 28 06:43:08.829227 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 445/888] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:08 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:09.012923 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e7df6c1c-72e0-41d2-aa42-64c0f330bf84 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:09.013698 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e7df6c1c-72e0-41d2-aa42-64c0f330bf84 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] [instance: 3e9e64be-7751-4a35-9913-759b5aa65387] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:09.023558 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e7df6c1c-72e0-41d2-aa42-64c0f330bf84 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:09.024079 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e7df6c1c-72e0-41d2-aa42-64c0f330bf84 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:09.024940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e7df6c1c-72e0-41d2-aa42-64c0f330bf84 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:09.025432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e7df6c1c-72e0-41d2-aa42-64c0f330bf84 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:09.071792 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-e7df6c1c-72e0-41d2-aa42-64c0f330bf84 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] HTTP exception thrown: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 could not be found. Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e7df6c1c-72e0-41d2-aa42-64c0f330bf84 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Request method failure captured: Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 HTTP/1.1 Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i8Yaz_6wvsjWByxyzbgZTtfmq0L3xLP7Iom_Oy8baStEL_eNQ9EkGKrmKaNokYAXKpeARnAkEfR4UR4YKJcMPc8UMkQ9npbNhcQ0enuR6BqCbIlMD_49JSV2jXQy8_f0tqesffBlMg3hrxtGfs7PwYwglbqPsCCYwPZ0hSxmwceMUo Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: 6b7e4c91aaaf48e2b134128055919a47 Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-TestMinimumBasicScenario-617398025 Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:43:09.073430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6b7e4c91aaaf48e2b134128055919a47", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6b7e4c91aaaf48e2b134128055919a47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6b7e4c91aaaf48e2b134128055919a47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6b7e4c91aaaf48e2b134128055919a47"}]}] Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-TestMinimumBasicScenario-617398025 Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: 6b7e4c91aaaf48e2b134128055919a47 Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-TestMinimumBasicScenario-617398025 Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-TestMinimumBasicScenario-617398025-project Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 93dacbaabf7343bbae337761b8d8cd41 Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-TestMinimumBasicScenario-617398025-project Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 could not be found. Jul 28 06:43:09.075050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '3e9e64be-7751-4a35-9913-759b5aa65387'} Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 could not be found. Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:43:09.075974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 could not be found. Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 could not be found. Jul 28 06:43:09.077400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:09.079124 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-68137b22-69d0-4379-83b7-adeac74ff466 req-90f87e70-e74a-462c-bd15-4266f0bf0c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "163a335a-d407-4ec6-9c94-f0d8e37e83d4", "tag": "dc86c76c-8061-4d08-8a5f-ec9bba7801ad"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:09.079592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e7df6c1c-72e0-41d2-aa42-64c0f330bf84 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Returning 404 to user: Instance 3e9e64be-7751-4a35-9913-759b5aa65387 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:43:09.080798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e7df6c1c-72e0-41d2-aa42-64c0f330bf84 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387" status: 404 len: 111 microversion: 2.1 time: 0.072430 Jul 28 06:43:09.082176 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 444/889] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:09 2022] GET /compute/v2.1/servers/3e9e64be-7751-4a35-9913-759b5aa65387 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:43:09.090810 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-85e35f11-2aa4-490a-afdb-1b589778fbf7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] Calling method '.version_select at 0x7f57476ba670>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:09.092752 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-68137b22-69d0-4379-83b7-adeac74ff466 req-90f87e70-e74a-462c-bd15-4266f0bf0c18 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:09.093503 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-68137b22-69d0-4379-83b7-adeac74ff466 req-90f87e70-e74a-462c-bd15-4266f0bf0c18 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:09.107678 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-68137b22-69d0-4379-83b7-adeac74ff466 req-90f87e70-e74a-462c-bd15-4266f0bf0c18 service nova] Creating event network-changed:dc86c76c-8061-4d08-8a5f-ec9bba7801ad for instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 on hv-cinder-85060 Jul 28 06:43:09.113228 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-68137b22-69d0-4379-83b7-adeac74ff466 req-90f87e70-e74a-462c-bd15-4266f0bf0c18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041986 Jul 28 06:43:09.114768 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 446/890] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:43:09.117928 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-85e35f11-2aa4-490a-afdb-1b589778fbf7 tempest-TestMinimumBasicScenario-617398025 tempest-TestMinimumBasicScenario-617398025-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2136817802" status: 202 len: 0 microversion: 2.1 time: 0.031525 Jul 28 06:43:09.119062 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 445/891] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Jul 28 06:43:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2136817802 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:43:09.854435 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-189eede2-b0f6-4756-b4aa-9d4a841f0a26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:09.855795 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-189eede2-b0f6-4756-b4aa-9d4a841f0a26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:09.863382 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-189eede2-b0f6-4756-b4aa-9d4a841f0a26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:09.863926 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-189eede2-b0f6-4756-b4aa-9d4a841f0a26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:09.865394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-189eede2-b0f6-4756-b4aa-9d4a841f0a26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:09.866017 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-189eede2-b0f6-4756-b4aa-9d4a841f0a26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:10.042088 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-189eede2-b0f6-4756-b4aa-9d4a841f0a26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:10.052230 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-189eede2-b0f6-4756-b4aa-9d4a841f0a26 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1191 microversion: 2.1 time: 0.203531 Jul 28 06:43:10.052803 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 447/892] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:09 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1191 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:11.075018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0b644652-f160-486b-a67d-e1f9536e1846 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:11.076254 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0b644652-f160-486b-a67d-e1f9536e1846 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:11.082702 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b644652-f160-486b-a67d-e1f9536e1846 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:11.083251 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b644652-f160-486b-a67d-e1f9536e1846 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:11.084075 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b644652-f160-486b-a67d-e1f9536e1846 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:11.084515 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0b644652-f160-486b-a67d-e1f9536e1846 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:11.148784 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0b644652-f160-486b-a67d-e1f9536e1846 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:11.156837 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0b644652-f160-486b-a67d-e1f9536e1846 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1197 microversion: 2.1 time: 0.085720 Jul 28 06:43:11.157428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 446/893] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:11 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:12.179254 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-100430d8-821f-45d0-9ab2-22f483e1ef76 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:12.179994 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-100430d8-821f-45d0-9ab2-22f483e1ef76 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:12.186890 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-100430d8-821f-45d0-9ab2-22f483e1ef76 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:12.187335 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-100430d8-821f-45d0-9ab2-22f483e1ef76 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:12.188106 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-100430d8-821f-45d0-9ab2-22f483e1ef76 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:12.188539 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-100430d8-821f-45d0-9ab2-22f483e1ef76 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:12.476301 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-100430d8-821f-45d0-9ab2-22f483e1ef76 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:12.483912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-100430d8-821f-45d0-9ab2-22f483e1ef76 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.308651 Jul 28 06:43:12.484561 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 448/894] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:12 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:12.943925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-b9a30ee4-a338-44fc-a00d-c2fc85b94ab1 req-87489722-59c6-47a3-b2aa-b0edaa3f90ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4548c35e-a5d9-488d-843e-5e57b93661bd", "tag": "06e6823a-9903-414f-96e4-6652e6ed6b7a"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:12.970267 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-b9a30ee4-a338-44fc-a00d-c2fc85b94ab1 req-87489722-59c6-47a3-b2aa-b0edaa3f90ec service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:12.970717 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-b9a30ee4-a338-44fc-a00d-c2fc85b94ab1 req-87489722-59c6-47a3-b2aa-b0edaa3f90ec service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:12.999133 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-b9a30ee4-a338-44fc-a00d-c2fc85b94ab1 req-87489722-59c6-47a3-b2aa-b0edaa3f90ec service nova] Creating event network-changed:06e6823a-9903-414f-96e4-6652e6ed6b7a for instance 4548c35e-a5d9-488d-843e-5e57b93661bd on hv-cinder-85060 Jul 28 06:43:13.007225 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-b9a30ee4-a338-44fc-a00d-c2fc85b94ab1 req-87489722-59c6-47a3-b2aa-b0edaa3f90ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068863 Jul 28 06:43:13.009262 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 447/895] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:13.506846 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4ac9db03-b36e-44cb-b7ba-1fe7047341d9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:13.507448 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4ac9db03-b36e-44cb-b7ba-1fe7047341d9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:13.514202 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4ac9db03-b36e-44cb-b7ba-1fe7047341d9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:13.514915 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4ac9db03-b36e-44cb-b7ba-1fe7047341d9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:13.515693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4ac9db03-b36e-44cb-b7ba-1fe7047341d9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:13.516300 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4ac9db03-b36e-44cb-b7ba-1fe7047341d9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:13.657160 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4ac9db03-b36e-44cb-b7ba-1fe7047341d9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:13.659512 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:13.667743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4ac9db03-b36e-44cb-b7ba-1fe7047341d9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.165638 Jul 28 06:43:13.668324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 449/896] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:13 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:14.689858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5b816d01-1fea-4504-85d1-17009df7a9e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:14.689858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5b816d01-1fea-4504-85d1-17009df7a9e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:14.713100 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b816d01-1fea-4504-85d1-17009df7a9e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:14.713899 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b816d01-1fea-4504-85d1-17009df7a9e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:14.715901 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b816d01-1fea-4504-85d1-17009df7a9e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:14.717228 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b816d01-1fea-4504-85d1-17009df7a9e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:14.966559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5b816d01-1fea-4504-85d1-17009df7a9e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:14.974619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5b816d01-1fea-4504-85d1-17009df7a9e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.290184 Jul 28 06:43:14.975704 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 448/897] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:14 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:15.996878 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2d263e99-0162-42d9-9d51-0ed652880669 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:15.997615 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2d263e99-0162-42d9-9d51-0ed652880669 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:16.006533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d263e99-0162-42d9-9d51-0ed652880669 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:16.007068 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d263e99-0162-42d9-9d51-0ed652880669 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:16.007841 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d263e99-0162-42d9-9d51-0ed652880669 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:16.008275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2d263e99-0162-42d9-9d51-0ed652880669 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:16.197458 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2d263e99-0162-42d9-9d51-0ed652880669 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:16.205734 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2d263e99-0162-42d9-9d51-0ed652880669 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.213154 Jul 28 06:43:16.206352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 450/898] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:15 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:17.228443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e546971a-be81-427f-9383-c54f4c767a9c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:17.229714 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e546971a-be81-427f-9383-c54f4c767a9c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:17.236997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e546971a-be81-427f-9383-c54f4c767a9c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:17.237458 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e546971a-be81-427f-9383-c54f4c767a9c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:17.238229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e546971a-be81-427f-9383-c54f4c767a9c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:17.238904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e546971a-be81-427f-9383-c54f4c767a9c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:17.257045 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=100 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:17.397408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e546971a-be81-427f-9383-c54f4c767a9c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:17.405358 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e546971a-be81-427f-9383-c54f4c767a9c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.181805 Jul 28 06:43:17.405954 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 449/899] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:17 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:18.426868 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-eb5ea15c-6ca1-4bef-874d-26cd98923e2b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:18.428288 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-eb5ea15c-6ca1-4bef-874d-26cd98923e2b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:18.435246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-eb5ea15c-6ca1-4bef-874d-26cd98923e2b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:18.436046 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-eb5ea15c-6ca1-4bef-874d-26cd98923e2b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:18.437054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-eb5ea15c-6ca1-4bef-874d-26cd98923e2b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:18.437767 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-eb5ea15c-6ca1-4bef-874d-26cd98923e2b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:18.591311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-eb5ea15c-6ca1-4bef-874d-26cd98923e2b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:18.601286 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-eb5ea15c-6ca1-4bef-874d-26cd98923e2b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.178598 Jul 28 06:43:18.616418 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 451/900] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:18 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:19.623705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-58c60102-68dc-4d5a-80e2-1afeee2bc63d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:19.624424 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-58c60102-68dc-4d5a-80e2-1afeee2bc63d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:19.626852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:19.627549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=6 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:19.628207 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:19.635894 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58c60102-68dc-4d5a-80e2-1afeee2bc63d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:19.636342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58c60102-68dc-4d5a-80e2-1afeee2bc63d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:19.637138 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58c60102-68dc-4d5a-80e2-1afeee2bc63d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:19.637615 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-58c60102-68dc-4d5a-80e2-1afeee2bc63d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:19.792289 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-58c60102-68dc-4d5a-80e2-1afeee2bc63d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:19.800370 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-58c60102-68dc-4d5a-80e2-1afeee2bc63d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.180485 Jul 28 06:43:19.800970 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 450/901] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:19 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:20.822840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1d7d8446-c2d2-4f7c-bda4-483da5b0c4c7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:20.823447 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1d7d8446-c2d2-4f7c-bda4-483da5b0c4c7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:20.825342 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:20.830592 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1d7d8446-c2d2-4f7c-bda4-483da5b0c4c7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:20.831032 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1d7d8446-c2d2-4f7c-bda4-483da5b0c4c7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:20.831779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1d7d8446-c2d2-4f7c-bda4-483da5b0c4c7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:20.832207 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1d7d8446-c2d2-4f7c-bda4-483da5b0c4c7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:20.964229 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1d7d8446-c2d2-4f7c-bda4-483da5b0c4c7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:20.971627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1d7d8446-c2d2-4f7c-bda4-483da5b0c4c7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.152794 Jul 28 06:43:20.972228 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 452/902] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:20 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:21.993272 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-53495a41-1150-4e93-953b-a2ea1dd3394c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:21.993911 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-53495a41-1150-4e93-953b-a2ea1dd3394c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:22.000373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-53495a41-1150-4e93-953b-a2ea1dd3394c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:22.000833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-53495a41-1150-4e93-953b-a2ea1dd3394c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:22.001656 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-53495a41-1150-4e93-953b-a2ea1dd3394c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:22.002093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-53495a41-1150-4e93-953b-a2ea1dd3394c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:22.136352 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-53495a41-1150-4e93-953b-a2ea1dd3394c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:22.143760 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-53495a41-1150-4e93-953b-a2ea1dd3394c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.154775 Jul 28 06:43:22.144322 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 451/903] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:21 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:23.138532 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e21f16a5-967a-4203-a027-0602981b8a8b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:23.139141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e21f16a5-967a-4203-a027-0602981b8a8b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:23.146675 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e21f16a5-967a-4203-a027-0602981b8a8b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:23.147128 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e21f16a5-967a-4203-a027-0602981b8a8b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:23.147900 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e21f16a5-967a-4203-a027-0602981b8a8b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:23.148334 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e21f16a5-967a-4203-a027-0602981b8a8b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:23.164175 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-cbc866d1-caa1-4a3d-ac34-efa76466b685 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:23.165479 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-cbc866d1-caa1-4a3d-ac34-efa76466b685 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:23.171546 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cbc866d1-caa1-4a3d-ac34-efa76466b685 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:23.172005 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cbc866d1-caa1-4a3d-ac34-efa76466b685 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:23.172416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e21f16a5-967a-4203-a027-0602981b8a8b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/ips" status: 200 len: 150 microversion: 2.1 time: 0.037786 Jul 28 06:43:23.172768 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cbc866d1-caa1-4a3d-ac34-efa76466b685 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:23.173206 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cbc866d1-caa1-4a3d-ac34-efa76466b685 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:23.179517 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 453/904] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Jul 28 06:43:23 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:23.316135 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-cbc866d1-caa1-4a3d-ac34-efa76466b685 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:23.327621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-cbc866d1-caa1-4a3d-ac34-efa76466b685 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.167412 Jul 28 06:43:23.328195 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 452/905] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:23 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:24.349659 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-55123c77-3469-4613-91b5-3bebc53376ec tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:24.350302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-55123c77-3469-4613-91b5-3bebc53376ec tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:24.356763 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-55123c77-3469-4613-91b5-3bebc53376ec tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:24.357218 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-55123c77-3469-4613-91b5-3bebc53376ec tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:24.358013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-55123c77-3469-4613-91b5-3bebc53376ec tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:24.358461 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-55123c77-3469-4613-91b5-3bebc53376ec tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:24.491923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-55123c77-3469-4613-91b5-3bebc53376ec tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:24.500921 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-55123c77-3469-4613-91b5-3bebc53376ec tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.155157 Jul 28 06:43:24.501895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 454/906] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:24 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:24.534216 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-fd8b54f1-1e2c-4b4d-9364-2cac67784aae tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8235050-3bb1-4e5e-a141-50c9b4ca1bf1"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:24.536861 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-fd8b54f1-1e2c-4b4d-9364-2cac67784aae tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:24.543426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fd8b54f1-1e2c-4b4d-9364-2cac67784aae tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:24.543928 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fd8b54f1-1e2c-4b4d-9364-2cac67784aae tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:24.544766 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fd8b54f1-1e2c-4b4d-9364-2cac67784aae tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:24.545278 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-fd8b54f1-1e2c-4b4d-9364-2cac67784aae tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:24.624224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-2e09b5cf-15a1-4f92-9417-066fa1de3039 req-d84cd086-fb53-4d70-9f9b-1559805dc637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4548c35e-a5d9-488d-843e-5e57b93661bd", "name": "network-vif-plugged", "status": "completed", "tag": "06e6823a-9903-414f-96e4-6652e6ed6b7a"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:24.636452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-2e09b5cf-15a1-4f92-9417-066fa1de3039 req-d84cd086-fb53-4d70-9f9b-1559805dc637 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:24.636935 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-2e09b5cf-15a1-4f92-9417-066fa1de3039 req-d84cd086-fb53-4d70-9f9b-1559805dc637 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:24.648960 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-2e09b5cf-15a1-4f92-9417-066fa1de3039 req-d84cd086-fb53-4d70-9f9b-1559805dc637 service nova] Creating event network-vif-plugged:06e6823a-9903-414f-96e4-6652e6ed6b7a for instance 4548c35e-a5d9-488d-843e-5e57b93661bd on hv-cinder-85060 Jul 28 06:43:24.654599 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-2e09b5cf-15a1-4f92-9417-066fa1de3039 req-d84cd086-fb53-4d70-9f9b-1559805dc637 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034987 Jul 28 06:43:24.655353 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 455/907] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:43:24.844951 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-fd8b54f1-1e2c-4b4d-9364-2cac67784aae tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314519 Jul 28 06:43:24.845733 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 453/908] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:43:24 2022] POST /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:25.524146 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a3b603f6-8b9c-48c8-bf0c-784320fa1b69 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:25.524861 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a3b603f6-8b9c-48c8-bf0c-784320fa1b69 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:25.531274 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3b603f6-8b9c-48c8-bf0c-784320fa1b69 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:25.531724 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3b603f6-8b9c-48c8-bf0c-784320fa1b69 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:25.532493 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3b603f6-8b9c-48c8-bf0c-784320fa1b69 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:25.532930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3b603f6-8b9c-48c8-bf0c-784320fa1b69 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:25.667184 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a3b603f6-8b9c-48c8-bf0c-784320fa1b69 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:25.674703 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a3b603f6-8b9c-48c8-bf0c-784320fa1b69 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1265 microversion: 2.1 time: 0.155958 Jul 28 06:43:25.675297 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 456/909] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:25 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:26.697609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dd54a923-cb01-46a6-9329-0b06e0cb101f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:26.698331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-dd54a923-cb01-46a6-9329-0b06e0cb101f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:26.704798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd54a923-cb01-46a6-9329-0b06e0cb101f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:26.705190 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd54a923-cb01-46a6-9329-0b06e0cb101f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:26.705982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd54a923-cb01-46a6-9329-0b06e0cb101f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:26.706417 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd54a923-cb01-46a6-9329-0b06e0cb101f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:26.851020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-dd54a923-cb01-46a6-9329-0b06e0cb101f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:26.858814 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-dd54a923-cb01-46a6-9329-0b06e0cb101f tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1452 microversion: 2.1 time: 0.166916 Jul 28 06:43:26.859389 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 454/910] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:26 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:26.879584 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7b7db9c0-f3c6-45fb-a791-8f8a279107f5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:26.880340 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7b7db9c0-f3c6-45fb-a791-8f8a279107f5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:26.886820 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7b7db9c0-f3c6-45fb-a791-8f8a279107f5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:26.887271 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7b7db9c0-f3c6-45fb-a791-8f8a279107f5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:26.888036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7b7db9c0-f3c6-45fb-a791-8f8a279107f5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:26.888476 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7b7db9c0-f3c6-45fb-a791-8f8a279107f5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:27.025102 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7b7db9c0-f3c6-45fb-a791-8f8a279107f5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:27.032671 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7b7db9c0-f3c6-45fb-a791-8f8a279107f5 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1452 microversion: 2.1 time: 0.157448 Jul 28 06:43:27.033235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 457/911] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:26 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:28.635543 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-09f5d8a7-474c-4ac0-98bb-7c033474311f req-6d229ccf-f719-457b-a361-cbe2b3a82b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4548c35e-a5d9-488d-843e-5e57b93661bd", "tag": "06e6823a-9903-414f-96e4-6652e6ed6b7a"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:28.646285 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-09f5d8a7-474c-4ac0-98bb-7c033474311f req-6d229ccf-f719-457b-a361-cbe2b3a82b4a service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:28.646710 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-09f5d8a7-474c-4ac0-98bb-7c033474311f req-6d229ccf-f719-457b-a361-cbe2b3a82b4a service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:28.657757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-09f5d8a7-474c-4ac0-98bb-7c033474311f req-6d229ccf-f719-457b-a361-cbe2b3a82b4a service nova] Creating event network-changed:06e6823a-9903-414f-96e4-6652e6ed6b7a for instance 4548c35e-a5d9-488d-843e-5e57b93661bd on hv-cinder-85060 Jul 28 06:43:28.663597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-09f5d8a7-474c-4ac0-98bb-7c033474311f req-6d229ccf-f719-457b-a361-cbe2b3a82b4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031822 Jul 28 06:43:28.664190 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 455/912] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:32.387614 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e73ad9dc-5183-4d87-951e-e6ad57a8dc07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8235050-3bb1-4e5e-a141-50c9b4ca1bf1"}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:32.390007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e73ad9dc-5183-4d87-951e-e6ad57a8dc07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:32.392454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:32.398492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e73ad9dc-5183-4d87-951e-e6ad57a8dc07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:32.398939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e73ad9dc-5183-4d87-951e-e6ad57a8dc07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:32.399697 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e73ad9dc-5183-4d87-951e-e6ad57a8dc07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:32.400125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e73ad9dc-5183-4d87-951e-e6ad57a8dc07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:32.481738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-e73ad9dc-5183-4d87-951e-e6ad57a8dc07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Invalid volume: volume a8235050-3bb1-4e5e-a141-50c9b4ca1bf1 is already attached to instances: 61ad6f45-a229-47fe-b992-d41f16bbaf72 Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e73ad9dc-5183-4d87-951e-e6ad57a8dc07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: POST /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments HTTP/1.1 Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 74 Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:43:32.483442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {"volumeAttachment": {"volumeId": "a8235050-3bb1-4e5e-a141-50c9b4ca1bf1"}} Jul 28 06:43:32.484997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Invalid volume: volume a8235050-3bb1-4e5e-a141-50c9b4ca1bf1 is already attached to instances: 61ad6f45-a229-47fe-b992-d41f16bbaf72 Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'server_id': '61ad6f45-a229-47fe-b992-d41f16bbaf72', 'body': {'volumeAttachment': {'volumeId': 'a8235050-3bb1-4e5e-a141-50c9b4ca1bf1'}}} Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a8235050-3bb1-4e5e-a141-50c9b4ca1bf1 is already attached to instances: 61ad6f45-a229-47fe-b992-d41f16bbaf72 Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:32.485833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a8235050-3bb1-4e5e-a141-50c9b4ca1bf1 is already attached to instances: 61ad6f45-a229-47fe-b992-d41f16bbaf72 Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:32.487047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:32.488318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:32.488318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:43:32.488318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:43:32.488318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a8235050-3bb1-4e5e-a141-50c9b4ca1bf1 is already attached to instances: 61ad6f45-a229-47fe-b992-d41f16bbaf72 Jul 28 06:43:32.488318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:32.488318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e73ad9dc-5183-4d87-951e-e6ad57a8dc07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 400 to user: Invalid volume: volume a8235050-3bb1-4e5e-a141-50c9b4ca1bf1 is already attached to instances: 61ad6f45-a229-47fe-b992-d41f16bbaf72 {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:43:32.488318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e73ad9dc-5183-4d87-951e-e6ad57a8dc07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101287 Jul 28 06:43:32.488318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 458/913] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:43:32 2022] POST /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:43:32.550541 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-df6901af-7191-42a9-8cf5-4e3b2a72535a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:32.551131 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-df6901af-7191-42a9-8cf5-4e3b2a72535a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:32.557430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df6901af-7191-42a9-8cf5-4e3b2a72535a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:32.557877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df6901af-7191-42a9-8cf5-4e3b2a72535a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:32.558630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df6901af-7191-42a9-8cf5-4e3b2a72535a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:32.559060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-df6901af-7191-42a9-8cf5-4e3b2a72535a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:32.639750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-df6901af-7191-42a9-8cf5-4e3b2a72535a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lazy-loading 'services' on Instance uuid 61ad6f45-a229-47fe-b992-d41f16bbaf72 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:43:32.713398 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-df6901af-7191-42a9-8cf5-4e3b2a72535a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments/a8235050-3bb1-4e5e-a141-50c9b4ca1bf1" status: 202 len: 0 microversion: 2.1 time: 0.167553 Jul 28 06:43:32.713987 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 456/914] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:43:32 2022] DELETE /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments/a8235050-3bb1-4e5e-a141-50c9b4ca1bf1 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:43:32.722312 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-21384519-0929-4604-b6ee-71666ea2f698 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:32.725178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-21384519-0929-4604-b6ee-71666ea2f698 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:32.732200 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-21384519-0929-4604-b6ee-71666ea2f698 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:32.732643 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-21384519-0929-4604-b6ee-71666ea2f698 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:32.733477 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-21384519-0929-4604-b6ee-71666ea2f698 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:32.733914 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-21384519-0929-4604-b6ee-71666ea2f698 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:32.763862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-21384519-0929-4604-b6ee-71666ea2f698 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045431 Jul 28 06:43:32.764518 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 459/915] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:43:32 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:33.778416 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-619f3b54-720f-4668-8f24-7411801a7084 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:33.781248 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-619f3b54-720f-4668-8f24-7411801a7084 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:33.789259 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-619f3b54-720f-4668-8f24-7411801a7084 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:33.789731 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-619f3b54-720f-4668-8f24-7411801a7084 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:33.790501 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-619f3b54-720f-4668-8f24-7411801a7084 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:33.791034 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-619f3b54-720f-4668-8f24-7411801a7084 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:33.820844 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-619f3b54-720f-4668-8f24-7411801a7084 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047645 Jul 28 06:43:33.821466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 457/916] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:43:33 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:43:33.885137 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a670dd8b-6c81-4144-8504-e44c46d620e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:33.885712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a670dd8b-6c81-4144-8504-e44c46d620e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:33.892357 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a670dd8b-6c81-4144-8504-e44c46d620e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:33.892867 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a670dd8b-6c81-4144-8504-e44c46d620e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:33.893876 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a670dd8b-6c81-4144-8504-e44c46d620e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:33.894315 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a670dd8b-6c81-4144-8504-e44c46d620e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:33.920757 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a670dd8b-6c81-4144-8504-e44c46d620e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:43:33.994976 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a670dd8b-6c81-4144-8504-e44c46d620e1 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 204 len: 0 microversion: 2.1 time: 0.113396 Jul 28 06:43:33.995569 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 460/917] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:43:33 2022] DELETE /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:43:34.004465 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8a71ecc8-f6ae-4707-80ee-0740ac98a5e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:34.005236 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8a71ecc8-f6ae-4707-80ee-0740ac98a5e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:34.012548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a71ecc8-f6ae-4707-80ee-0740ac98a5e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:34.012994 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a71ecc8-f6ae-4707-80ee-0740ac98a5e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:34.013782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a71ecc8-f6ae-4707-80ee-0740ac98a5e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:34.014219 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8a71ecc8-f6ae-4707-80ee-0740ac98a5e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:34.145602 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8a71ecc8-f6ae-4707-80ee-0740ac98a5e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:34.153143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8a71ecc8-f6ae-4707-80ee-0740ac98a5e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1681 microversion: 2.1 time: 0.152516 Jul 28 06:43:34.153744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 458/918] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:33 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:35.175670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7a174fea-5c00-4288-a5e4-3aec18608a9d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:35.176376 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7a174fea-5c00-4288-a5e4-3aec18608a9d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:35.182966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a174fea-5c00-4288-a5e4-3aec18608a9d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:35.183419 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a174fea-5c00-4288-a5e4-3aec18608a9d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:35.184187 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a174fea-5c00-4288-a5e4-3aec18608a9d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:35.184624 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7a174fea-5c00-4288-a5e4-3aec18608a9d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:35.320591 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7a174fea-5c00-4288-a5e4-3aec18608a9d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:35.328069 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7a174fea-5c00-4288-a5e4-3aec18608a9d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1681 microversion: 2.1 time: 0.156647 Jul 28 06:43:35.328627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 461/919] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:35 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:36.350447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0d0876d0-878c-46e7-a1e6-ef24f76c9d9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:36.351008 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0d0876d0-878c-46e7-a1e6-ef24f76c9d9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:36.357787 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d0876d0-878c-46e7-a1e6-ef24f76c9d9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:36.358241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d0876d0-878c-46e7-a1e6-ef24f76c9d9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:36.359011 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d0876d0-878c-46e7-a1e6-ef24f76c9d9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:36.359446 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0d0876d0-878c-46e7-a1e6-ef24f76c9d9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:36.496033 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0d0876d0-878c-46e7-a1e6-ef24f76c9d9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:36.503442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0d0876d0-878c-46e7-a1e6-ef24f76c9d9a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1681 microversion: 2.1 time: 0.157431 Jul 28 06:43:36.504000 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 459/920] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:36 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:36.855856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d758cc06-646f-4d3b-bc83-b66059bfb548 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:36.856654 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d758cc06-646f-4d3b-bc83-b66059bfb548 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:36.863932 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d758cc06-646f-4d3b-bc83-b66059bfb548 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:36.864662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d758cc06-646f-4d3b-bc83-b66059bfb548 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:36.866336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d758cc06-646f-4d3b-bc83-b66059bfb548 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:36.866954 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d758cc06-646f-4d3b-bc83-b66059bfb548 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:36.906688 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-5c31113d-3ec5-4bab-ae28-0317b9eb06c2 req-08b8b496-db9c-45f7-8276-00abbacfe137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ad6f45-a229-47fe-b992-d41f16bbaf72", "name": "network-vif-deleted", "tag": "fffdf017-fca8-4862-83d9-4dcfd53d9e5a"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:36.916738 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-5c31113d-3ec5-4bab-ae28-0317b9eb06c2 req-08b8b496-db9c-45f7-8276-00abbacfe137 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:36.917186 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-5c31113d-3ec5-4bab-ae28-0317b9eb06c2 req-08b8b496-db9c-45f7-8276-00abbacfe137 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:36.929972 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-5c31113d-3ec5-4bab-ae28-0317b9eb06c2 req-08b8b496-db9c-45f7-8276-00abbacfe137 service nova] Creating event network-vif-deleted:fffdf017-fca8-4862-83d9-4dcfd53d9e5a for instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 on hv-cinder-85060 Jul 28 06:43:36.935978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-5c31113d-3ec5-4bab-ae28-0317b9eb06c2 req-08b8b496-db9c-45f7-8276-00abbacfe137 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Jul 28 06:43:36.942733 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 460/921] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:43:37.007216 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-d758cc06-646f-4d3b-bc83-b66059bfb548 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lazy-loading 'services' on Instance uuid 65a88fd0-386e-4cde-bddf-205dea943fc9 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:43:37.126032 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d758cc06-646f-4d3b-bc83-b66059bfb548 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments/b9647703-92d3-4a65-a7bd-0ad21cb4f872" status: 202 len: 0 microversion: 2.1 time: 0.274628 Jul 28 06:43:37.126753 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 462/922] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:43:36 2022] DELETE /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments/b9647703-92d3-4a65-a7bd-0ad21cb4f872 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:43:37.136000 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-171b8949-c3bc-4afe-a329-6376540929d7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:37.138323 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-171b8949-c3bc-4afe-a329-6376540929d7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:37.145039 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-171b8949-c3bc-4afe-a329-6376540929d7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:37.145673 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-171b8949-c3bc-4afe-a329-6376540929d7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:37.147001 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-171b8949-c3bc-4afe-a329-6376540929d7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:37.147569 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-171b8949-c3bc-4afe-a329-6376540929d7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:37.184317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-171b8949-c3bc-4afe-a329-6376540929d7 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052585 Jul 28 06:43:37.189574 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 461/923] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:43:37 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:43:37.527020 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:37.527947 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:37.535877 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:37.536514 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:37.537657 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:37.538254 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:37.573139 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:37.573613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:37.574062 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lazy-loading 'fault' on Instance uuid 61ad6f45-a229-47fe-b992-d41f16bbaf72 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:43:37.627152 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:37.634123 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-888032a0-eaaa-4e87-ad18-fa9e65837b14 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 200 len: 1331 microversion: 2.1 time: 0.111216 Jul 28 06:43:37.634683 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 463/924] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:37 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:38.196849 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1aa20bef-4bec-4cfc-9724-030e63b6a10e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:38.199017 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1aa20bef-4bec-4cfc-9724-030e63b6a10e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:38.205407 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1aa20bef-4bec-4cfc-9724-030e63b6a10e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:38.205871 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1aa20bef-4bec-4cfc-9724-030e63b6a10e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:38.206638 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1aa20bef-4bec-4cfc-9724-030e63b6a10e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:38.207079 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1aa20bef-4bec-4cfc-9724-030e63b6a10e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:38.235847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1aa20bef-4bec-4cfc-9724-030e63b6a10e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043910 Jul 28 06:43:38.236400 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 462/925] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:43:38 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:38.655596 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-da0df4b4-a4cb-40bf-8c4d-24f7074bbfcb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:38.656214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-da0df4b4-a4cb-40bf-8c4d-24f7074bbfcb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:38.662715 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-da0df4b4-a4cb-40bf-8c4d-24f7074bbfcb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:38.663164 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-da0df4b4-a4cb-40bf-8c4d-24f7074bbfcb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:38.663931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-da0df4b4-a4cb-40bf-8c4d-24f7074bbfcb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:38.664366 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-da0df4b4-a4cb-40bf-8c4d-24f7074bbfcb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:38.677628 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-da0df4b4-a4cb-40bf-8c4d-24f7074bbfcb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-da0df4b4-a4cb-40bf-8c4d-24f7074bbfcb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 HTTP/1.1 Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:43:38.679253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:43:38.681371 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '61ad6f45-a229-47fe-b992-d41f16bbaf72'} Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:43:38.682302 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:43:38.683997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:38.685695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-da0df4b4-a4cb-40bf-8c4d-24f7074bbfcb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:43:38.685695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-da0df4b4-a4cb-40bf-8c4d-24f7074bbfcb tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 404 len: 111 microversion: 2.1 time: 0.028973 Jul 28 06:43:38.685695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 464/926] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:38 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:43:38.690905 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-05ae1fca-0d3f-422d-a41f-9aa64a032870 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '.version_select at 0x7f57476ba3a0>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:38.716457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-05ae1fca-0d3f-422d-a41f-9aa64a032870 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926123367" status: 202 len: 0 microversion: 2.1 time: 0.029216 Jul 28 06:43:38.716959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 463/927] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Jul 28 06:43:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926123367 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:43:39.248383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-159ae069-711d-4742-98ca-e0073537aa9d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:39.250821 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-159ae069-711d-4742-98ca-e0073537aa9d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:39.256869 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-159ae069-711d-4742-98ca-e0073537aa9d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:39.257348 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-159ae069-711d-4742-98ca-e0073537aa9d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:39.258122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-159ae069-711d-4742-98ca-e0073537aa9d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:39.258560 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-159ae069-711d-4742-98ca-e0073537aa9d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:39.272270 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:39.291613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-159ae069-711d-4742-98ca-e0073537aa9d tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047074 Jul 28 06:43:39.292106 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 465/928] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:43:39 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:43:39.366652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5b248b39-be4b-41f3-bd9a-44e3b52ed6f4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:39.367205 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5b248b39-be4b-41f3-bd9a-44e3b52ed6f4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:39.373621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b248b39-be4b-41f3-bd9a-44e3b52ed6f4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:39.374151 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b248b39-be4b-41f3-bd9a-44e3b52ed6f4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:39.375028 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b248b39-be4b-41f3-bd9a-44e3b52ed6f4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:39.375468 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5b248b39-be4b-41f3-bd9a-44e3b52ed6f4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:39.402114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5b248b39-be4b-41f3-bd9a-44e3b52ed6f4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Going to try to terminate instance {{(pid=124563) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:43:39.453409 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:39.482186 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5b248b39-be4b-41f3-bd9a-44e3b52ed6f4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 204 len: 0 microversion: 2.1 time: 0.119767 Jul 28 06:43:39.482975 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 464/929] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:43:39 2022] DELETE /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:43:39.490982 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f3da9922-e39c-4632-8ab9-60227aeeea5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:39.491687 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f3da9922-e39c-4632-8ab9-60227aeeea5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:39.498571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3da9922-e39c-4632-8ab9-60227aeeea5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:39.499164 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3da9922-e39c-4632-8ab9-60227aeeea5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:39.500061 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3da9922-e39c-4632-8ab9-60227aeeea5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:39.500596 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3da9922-e39c-4632-8ab9-60227aeeea5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:39.611251 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-72891376-a4af-4b2a-b4b6-630e2091e4e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: .version_select at 0x7f574c030430>, body: {"keypair": {"name": "tempest-keypair-2116091931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGff5zcHAzrieIQBspq2Xn8yvN/JV218XQ/gxXWBYfU9ZmyM2A9AGY3OzAJxtu+OXnyxiNss5oUZ/yI3qUCnDavwyrApHfqkYuYPLbsc89/poRpA/+iW9OE4THzOggIOsw=="}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:39.627767 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-72891376-a4af-4b2a-b4b6-630e2091e4e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'key_pairs'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:43:39.631582 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-72891376-a4af-4b2a-b4b6-630e2091e4e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for user 4a1db92e28444854b9de817dd36104ea and project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'key_pairs'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:43:39.642488 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f3da9922-e39c-4632-8ab9-60227aeeea5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:39.652114 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f3da9922-e39c-4632-8ab9-60227aeeea5b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1691 microversion: 2.1 time: 0.164758 Jul 28 06:43:39.652801 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 466/930] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:39 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:39.666572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-72891376-a4af-4b2a-b4b6-630e2091e4e6 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048139 Jul 28 06:43:39.666572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 465/931] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Jul 28 06:43:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:43:40.674328 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-aeebeb88-fb68-48e0-9f24-288440fa4f9b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:40.674850 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-aeebeb88-fb68-48e0-9f24-288440fa4f9b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:40.681726 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aeebeb88-fb68-48e0-9f24-288440fa4f9b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:40.682184 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aeebeb88-fb68-48e0-9f24-288440fa4f9b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:40.682927 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aeebeb88-fb68-48e0-9f24-288440fa4f9b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:40.683356 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-aeebeb88-fb68-48e0-9f24-288440fa4f9b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:40.815813 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-aeebeb88-fb68-48e0-9f24-288440fa4f9b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:40.824218 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-aeebeb88-fb68-48e0-9f24-288440fa4f9b tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1691 microversion: 2.1 time: 0.153811 Jul 28 06:43:40.824818 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 467/932] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:40 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:40.936423 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-710680311", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1658fcaf-8835-445a-a4cf-3f4534b3861e"}], "security_groups": [{"name": "tempest-securitygroup--1169893831"}], "key_name": "tempest-keypair-2116091931", "user_data": "}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:41.045316 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] validate_networks() for [('1658fcaf-8835-445a-a4cf-3f4534b3861e', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:43:41.414408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:43:41.414675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:43:41.415177 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:43:41.415894 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:43:41.416316 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:43:41.425587 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:41.426034 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:41.426832 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:41.427266 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:41.444589 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:43:41.449649 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Getting quotas for user 4a1db92e28444854b9de817dd36104ea and project dcffc8bbe6ec425997d67634a0f7d724. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:43:41.460750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:43:41.463174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:43:41.507920 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-147cbda2-a071-4f58-83c4-666aa5fc8d72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.575691 Jul 28 06:43:41.508501 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 466/933] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:43:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:43:41.520010 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-fc401463-6748-4c85-b689-6900ed75bc72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:41.520746 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-fc401463-6748-4c85-b689-6900ed75bc72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:41.577434 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-fc401463-6748-4c85-b689-6900ed75bc72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:41.584130 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-fc401463-6748-4c85-b689-6900ed75bc72 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1241 microversion: 2.1 time: 0.068013 Jul 28 06:43:41.585011 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 468/934] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:41 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:41.845558 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-342ac2a6-9dc2-4aaa-a24e-c4f1d835e843 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:41.846168 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-342ac2a6-9dc2-4aaa-a24e-c4f1d835e843 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:41.852235 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-342ac2a6-9dc2-4aaa-a24e-c4f1d835e843 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:41.852873 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-342ac2a6-9dc2-4aaa-a24e-c4f1d835e843 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:41.853716 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-342ac2a6-9dc2-4aaa-a24e-c4f1d835e843 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:41.854180 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-342ac2a6-9dc2-4aaa-a24e-c4f1d835e843 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:42.134733 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-342ac2a6-9dc2-4aaa-a24e-c4f1d835e843 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:42.142156 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-342ac2a6-9dc2-4aaa-a24e-c4f1d835e843 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1691 microversion: 2.1 time: 0.300682 Jul 28 06:43:42.142718 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 467/935] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:41 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1691 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:42.604788 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-800c11b4-2f27-41c4-8279-7196dd72567a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:42.605427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-800c11b4-2f27-41c4-8279-7196dd72567a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:42.612025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-800c11b4-2f27-41c4-8279-7196dd72567a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:42.612473 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-800c11b4-2f27-41c4-8279-7196dd72567a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:42.613238 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-800c11b4-2f27-41c4-8279-7196dd72567a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:42.613714 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-800c11b4-2f27-41c4-8279-7196dd72567a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:42.676118 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-800c11b4-2f27-41c4-8279-7196dd72567a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:42.683750 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-800c11b4-2f27-41c4-8279-7196dd72567a tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1245 microversion: 2.1 time: 0.082886 Jul 28 06:43:42.684313 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 469/936] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:42 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:43.163582 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5a15dffe-fb00-4aa3-b2a1-e6a78bde623c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:43.164184 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5a15dffe-fb00-4aa3-b2a1-e6a78bde623c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:43.170780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a15dffe-fb00-4aa3-b2a1-e6a78bde623c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:43.171227 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a15dffe-fb00-4aa3-b2a1-e6a78bde623c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:43.171982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a15dffe-fb00-4aa3-b2a1-e6a78bde623c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:43.172416 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5a15dffe-fb00-4aa3-b2a1-e6a78bde623c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:43.299221 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5a15dffe-fb00-4aa3-b2a1-e6a78bde623c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:43.307379 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5a15dffe-fb00-4aa3-b2a1-e6a78bde623c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1691 microversion: 2.1 time: 0.147666 Jul 28 06:43:43.307929 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 468/937] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:43 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:43.706290 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6da36875-ddec-4afd-b135-1f0d40de1ced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:43.706809 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6da36875-ddec-4afd-b135-1f0d40de1ced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:43.714098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6da36875-ddec-4afd-b135-1f0d40de1ced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:43.714554 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6da36875-ddec-4afd-b135-1f0d40de1ced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:43.715320 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6da36875-ddec-4afd-b135-1f0d40de1ced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:43.715758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6da36875-ddec-4afd-b135-1f0d40de1ced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:43.777744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6da36875-ddec-4afd-b135-1f0d40de1ced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:43.786150 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6da36875-ddec-4afd-b135-1f0d40de1ced tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1293 microversion: 2.1 time: 0.084430 Jul 28 06:43:43.786735 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 470/938] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:43 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:44.328262 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-36406e04-9812-4a66-8700-aea0d8492228 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:44.329492 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-36406e04-9812-4a66-8700-aea0d8492228 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:44.336170 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-36406e04-9812-4a66-8700-aea0d8492228 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:44.337408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-36406e04-9812-4a66-8700-aea0d8492228 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:44.338747 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-36406e04-9812-4a66-8700-aea0d8492228 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:44.339287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-36406e04-9812-4a66-8700-aea0d8492228 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:44.492636 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-36406e04-9812-4a66-8700-aea0d8492228 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:44.500748 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-36406e04-9812-4a66-8700-aea0d8492228 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1691 microversion: 2.1 time: 0.176450 Jul 28 06:43:44.501336 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 469/939] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:44 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:44.808878 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a8ba0009-04cf-4594-bb2a-36efd87f3b91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:44.809454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a8ba0009-04cf-4594-bb2a-36efd87f3b91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:44.816128 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a8ba0009-04cf-4594-bb2a-36efd87f3b91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:44.816583 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a8ba0009-04cf-4594-bb2a-36efd87f3b91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:44.817656 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a8ba0009-04cf-4594-bb2a-36efd87f3b91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:44.818121 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a8ba0009-04cf-4594-bb2a-36efd87f3b91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:44.910639 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a8ba0009-04cf-4594-bb2a-36efd87f3b91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:44.919225 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a8ba0009-04cf-4594-bb2a-36efd87f3b91 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1299 microversion: 2.1 time: 0.115178 Jul 28 06:43:44.919883 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 471/940] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:44 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:45.454029 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-c83b59d7-ace4-474d-94c9-e50d4e605d3d req-a0359396-cd74-4825-bda9-e3ec06dfe79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a88fd0-386e-4cde-bddf-205dea943fc9", "name": "network-vif-deleted", "tag": "fd589bac-7a7d-4978-bdbb-17282786c967"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:45.468099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-c83b59d7-ace4-474d-94c9-e50d4e605d3d req-a0359396-cd74-4825-bda9-e3ec06dfe79b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:45.469265 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-c83b59d7-ace4-474d-94c9-e50d4e605d3d req-a0359396-cd74-4825-bda9-e3ec06dfe79b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:45.498792 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-c83b59d7-ace4-474d-94c9-e50d4e605d3d req-a0359396-cd74-4825-bda9-e3ec06dfe79b service nova] Creating event network-vif-deleted:fd589bac-7a7d-4978-bdbb-17282786c967 for instance 65a88fd0-386e-4cde-bddf-205dea943fc9 on hv-cinder-85060 Jul 28 06:43:45.506349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-c83b59d7-ace4-474d-94c9-e50d4e605d3d req-a0359396-cd74-4825-bda9-e3ec06dfe79b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057257 Jul 28 06:43:45.507512 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 470/941] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:45.525888 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-8ccdb4b3-ac94-40e6-a2e0-9a8c0c3c375e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:45.526635 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-8ccdb4b3-ac94-40e6-a2e0-9a8c0c3c375e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:45.554840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8ccdb4b3-ac94-40e6-a2e0-9a8c0c3c375e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:45.560343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8ccdb4b3-ac94-40e6-a2e0-9a8c0c3c375e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:45.563584 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8ccdb4b3-ac94-40e6-a2e0-9a8c0c3c375e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:45.564454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8ccdb4b3-ac94-40e6-a2e0-9a8c0c3c375e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:45.666708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8ccdb4b3-ac94-40e6-a2e0-9a8c0c3c375e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:45.675288 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-8ccdb4b3-ac94-40e6-a2e0-9a8c0c3c375e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 200 len: 1331 microversion: 2.1 time: 0.153983 Jul 28 06:43:45.675860 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 472/942] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:45 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 1331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:45.940714 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6636a9a5-3a49-4ebc-a674-531b489ce589 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:45.941621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6636a9a5-3a49-4ebc-a674-531b489ce589 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:45.949357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6636a9a5-3a49-4ebc-a674-531b489ce589 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:45.950132 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6636a9a5-3a49-4ebc-a674-531b489ce589 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:45.951000 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6636a9a5-3a49-4ebc-a674-531b489ce589 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:45.951675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6636a9a5-3a49-4ebc-a674-531b489ce589 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:46.103425 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6636a9a5-3a49-4ebc-a674-531b489ce589 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:46.120028 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6636a9a5-3a49-4ebc-a674-531b489ce589 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1367 microversion: 2.1 time: 0.183405 Jul 28 06:43:46.123432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 471/943] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:45 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:46.696865 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5dd2a789-a038-4a68-862e-73c1dace3fe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:46.697665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5dd2a789-a038-4a68-862e-73c1dace3fe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 65a88fd0-386e-4cde-bddf-205dea943fc9] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:46.704135 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5dd2a789-a038-4a68-862e-73c1dace3fe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:46.704674 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5dd2a789-a038-4a68-862e-73c1dace3fe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:46.705550 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5dd2a789-a038-4a68-862e-73c1dace3fe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:46.706051 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5dd2a789-a038-4a68-862e-73c1dace3fe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:46.720355 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-5dd2a789-a038-4a68-862e-73c1dace3fe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] HTTP exception thrown: Instance 65a88fd0-386e-4cde-bddf-205dea943fc9 could not be found. Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5dd2a789-a038-4a68-862e-73c1dace3fe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Request method failure captured: Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 HTTP/1.1 Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6gL3NkHM14I48tiw5dWARRiVlSX6hjzNDYLhrttt-VpWAx6eXR5kUxZBDUlxCkX-fjq73lfPcjtweW5Eo4lRq0y_dlqVzl41Z6FONmvJzGg1r1nfLlC1eo1-rYp9LQrqHOfMHzFaI4teQM8o0fNLhLpKdrVeIXiaMq8dsMMjOvMfQ Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: 0fb2f4ad616e43f5a9a248390bd0aebf Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:43:46.721987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fb2f4ad616e43f5a9a248390bd0aebf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fb2f4ad616e43f5a9a248390bd0aebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fb2f4ad616e43f5a9a248390bd0aebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fb2f4ad616e43f5a9a248390bd0aebf"}]}] Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: 0fb2f4ad616e43f5a9a248390bd0aebf Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-ServerRescueNegativeTestJSON-690058944-project Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: a2080efc6cbd471995593012bc268765 Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690058944-project Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 65a88fd0-386e-4cde-bddf-205dea943fc9 could not be found. Jul 28 06:43:46.723579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '65a88fd0-386e-4cde-bddf-205dea943fc9'} Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a88fd0-386e-4cde-bddf-205dea943fc9 could not be found. Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:43:46.724394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a88fd0-386e-4cde-bddf-205dea943fc9 could not be found. Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a88fd0-386e-4cde-bddf-205dea943fc9 could not be found. Jul 28 06:43:46.725738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:43:46.727348 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5dd2a789-a038-4a68-862e-73c1dace3fe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Returning 404 to user: Instance 65a88fd0-386e-4cde-bddf-205dea943fc9 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:43:46.727348 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5dd2a789-a038-4a68-862e-73c1dace3fe4 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9" status: 404 len: 111 microversion: 2.1 time: 0.030771 Jul 28 06:43:46.732218 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5f9c37ab-e6a4-499d-a75a-f49adef75169 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '.version_select at 0x7f5747654b80>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:46.735829 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 473/944] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:46 2022] GET /compute/v2.1/servers/65a88fd0-386e-4cde-bddf-205dea943fc9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:43:46.751767 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5f9c37ab-e6a4-499d-a75a-f49adef75169 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788729281" status: 202 len: 0 microversion: 2.1 time: 0.023397 Jul 28 06:43:46.752326 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 472/945] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Jul 28 06:43:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788729281 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:43:47.146330 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-986150f1-5aa9-487f-97ad-51ecae88819d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:47.146948 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-986150f1-5aa9-487f-97ad-51ecae88819d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:47.153879 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-986150f1-5aa9-487f-97ad-51ecae88819d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:47.154332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-986150f1-5aa9-487f-97ad-51ecae88819d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:47.155111 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-986150f1-5aa9-487f-97ad-51ecae88819d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:47.155548 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-986150f1-5aa9-487f-97ad-51ecae88819d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:47.288899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-986150f1-5aa9-487f-97ad-51ecae88819d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:47.297432 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-986150f1-5aa9-487f-97ad-51ecae88819d tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1367 microversion: 2.1 time: 0.154927 Jul 28 06:43:47.298009 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 474/946] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:47 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:47.554678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-f5dbf5ac-c07f-442b-b633-11bd83fb9f1e req-37bbfbc8-158b-41f4-a8f3-95aab49a833d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d535ac71-ff1d-4f41-95b0-6c780e3b0ed1", "tag": "3085368c-234d-4061-8c70-32b4923f475e"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:47.565710 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-f5dbf5ac-c07f-442b-b633-11bd83fb9f1e req-37bbfbc8-158b-41f4-a8f3-95aab49a833d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:47.566158 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-f5dbf5ac-c07f-442b-b633-11bd83fb9f1e req-37bbfbc8-158b-41f4-a8f3-95aab49a833d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:47.578719 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-f5dbf5ac-c07f-442b-b633-11bd83fb9f1e req-37bbfbc8-158b-41f4-a8f3-95aab49a833d service nova] Creating event network-changed:3085368c-234d-4061-8c70-32b4923f475e for instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 on hv-cinder-85060 Jul 28 06:43:47.583878 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-f5dbf5ac-c07f-442b-b633-11bd83fb9f1e req-37bbfbc8-158b-41f4-a8f3-95aab49a833d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032999 Jul 28 06:43:47.584486 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 473/947] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:48.319578 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-86637c49-8ed8-4fb6-972f-fa9e0484846c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:48.320196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-86637c49-8ed8-4fb6-972f-fa9e0484846c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:48.326895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-86637c49-8ed8-4fb6-972f-fa9e0484846c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:48.327345 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-86637c49-8ed8-4fb6-972f-fa9e0484846c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:48.328132 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-86637c49-8ed8-4fb6-972f-fa9e0484846c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:48.328570 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-86637c49-8ed8-4fb6-972f-fa9e0484846c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:48.815226 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-86637c49-8ed8-4fb6-972f-fa9e0484846c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:48.823597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-86637c49-8ed8-4fb6-972f-fa9e0484846c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1367 microversion: 2.1 time: 0.508194 Jul 28 06:43:48.824182 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 475/948] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:48 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:49.635733 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-30e8c79f-b64d-4210-aeca-edaccf923e92 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:49.636327 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-30e8c79f-b64d-4210-aeca-edaccf923e92 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:49.642592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-30e8c79f-b64d-4210-aeca-edaccf923e92 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:49.643043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-30e8c79f-b64d-4210-aeca-edaccf923e92 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:49.643810 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-30e8c79f-b64d-4210-aeca-edaccf923e92 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:49.644253 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-30e8c79f-b64d-4210-aeca-edaccf923e92 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:49.670509 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-30e8c79f-b64d-4210-aeca-edaccf923e92 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Going to try to terminate instance {{(pid=124563) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:43:49.731291 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:49.748935 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-30e8c79f-b64d-4210-aeca-edaccf923e92 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 204 len: 0 microversion: 2.1 time: 0.118498 Jul 28 06:43:49.749767 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 474/949] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:43:49 2022] DELETE /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:43:49.757755 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-860c55d5-b01d-4c34-a641-ecebc80e7629 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:49.758470 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-860c55d5-b01d-4c34-a641-ecebc80e7629 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:49.764594 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-860c55d5-b01d-4c34-a641-ecebc80e7629 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:49.765037 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-860c55d5-b01d-4c34-a641-ecebc80e7629 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:49.765823 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-860c55d5-b01d-4c34-a641-ecebc80e7629 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:49.766252 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-860c55d5-b01d-4c34-a641-ecebc80e7629 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:49.844385 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d7d30e78-1bf1-4ad6-8955-ac8e6a25e8d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:49.845077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d7d30e78-1bf1-4ad6-8955-ac8e6a25e8d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:49.851067 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7d30e78-1bf1-4ad6-8955-ac8e6a25e8d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:49.851517 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7d30e78-1bf1-4ad6-8955-ac8e6a25e8d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:49.853017 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7d30e78-1bf1-4ad6-8955-ac8e6a25e8d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:49.853492 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d7d30e78-1bf1-4ad6-8955-ac8e6a25e8d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:49.905843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-860c55d5-b01d-4c34-a641-ecebc80e7629 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:49.913443 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-860c55d5-b01d-4c34-a641-ecebc80e7629 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1508 microversion: 2.1 time: 0.159703 Jul 28 06:43:49.914016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 476/950] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:49 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:49.986437 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d7d30e78-1bf1-4ad6-8955-ac8e6a25e8d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:49.993850 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d7d30e78-1bf1-4ad6-8955-ac8e6a25e8d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1367 microversion: 2.1 time: 0.153553 Jul 28 06:43:49.994406 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 475/951] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:49 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:50.935009 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5769653a-84f3-44e8-9b80-d993f1f6ef90 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:50.935610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5769653a-84f3-44e8-9b80-d993f1f6ef90 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:50.942300 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5769653a-84f3-44e8-9b80-d993f1f6ef90 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:50.942743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5769653a-84f3-44e8-9b80-d993f1f6ef90 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:50.943491 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5769653a-84f3-44e8-9b80-d993f1f6ef90 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:50.943917 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5769653a-84f3-44e8-9b80-d993f1f6ef90 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:51.015285 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-658c19aa-83a4-4bce-8c61-99622ca1610e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:51.015894 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-658c19aa-83a4-4bce-8c61-99622ca1610e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:51.022930 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-658c19aa-83a4-4bce-8c61-99622ca1610e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:51.023388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-658c19aa-83a4-4bce-8c61-99622ca1610e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:51.024484 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-658c19aa-83a4-4bce-8c61-99622ca1610e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:51.024943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-658c19aa-83a4-4bce-8c61-99622ca1610e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:51.160456 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-658c19aa-83a4-4bce-8c61-99622ca1610e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:51.169608 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-658c19aa-83a4-4bce-8c61-99622ca1610e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1367 microversion: 2.1 time: 0.158597 Jul 28 06:43:51.171760 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 476/952] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:51 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:51.224545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5769653a-84f3-44e8-9b80-d993f1f6ef90 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:51.232812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5769653a-84f3-44e8-9b80-d993f1f6ef90 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1508 microversion: 2.1 time: 0.302228 Jul 28 06:43:51.233396 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 477/953] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:50 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:52.048837 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-1afc7078-312f-47b8-ba76-1e80a4909468 req-73b5c0c6-371e-4563-9c15-0791b0a1be4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd097e6-598d-42a1-a3ad-5d8716bcb7fc", "name": "network-vif-deleted", "tag": "7d4c8835-d4d0-44cd-b343-088c09fffb3a"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:52.054754 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:52.055786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=10 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:52.062574 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-1afc7078-312f-47b8-ba76-1e80a4909468 req-73b5c0c6-371e-4563-9c15-0791b0a1be4c service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:52.063019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-1afc7078-312f-47b8-ba76-1e80a4909468 req-73b5c0c6-371e-4563-9c15-0791b0a1be4c service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:52.075478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-1afc7078-312f-47b8-ba76-1e80a4909468 req-73b5c0c6-371e-4563-9c15-0791b0a1be4c service nova] Creating event network-vif-deleted:7d4c8835-d4d0-44cd-b343-088c09fffb3a for instance 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc on hv-cinder-85060 Jul 28 06:43:52.080575 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-1afc7078-312f-47b8-ba76-1e80a4909468 req-73b5c0c6-371e-4563-9c15-0791b0a1be4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035311 Jul 28 06:43:52.081670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 477/954] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:52.191015 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a67f6511-8d77-4458-a4c0-13c57bda93e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:52.192098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a67f6511-8d77-4458-a4c0-13c57bda93e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:52.194006 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:52.202107 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a67f6511-8d77-4458-a4c0-13c57bda93e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:52.202559 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a67f6511-8d77-4458-a4c0-13c57bda93e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:52.203359 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a67f6511-8d77-4458-a4c0-13c57bda93e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:52.203813 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a67f6511-8d77-4458-a4c0-13c57bda93e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:52.253516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:52.254261 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:52.260988 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:52.261529 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:52.262291 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:52.262736 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:52.295025 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:52.295475 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:52.295917 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lazy-loading 'fault' on Instance uuid 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:43:52.343634 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a67f6511-8d77-4458-a4c0-13c57bda93e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:52.348750 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:52.351794 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a67f6511-8d77-4458-a4c0-13c57bda93e4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1367 microversion: 2.1 time: 0.164914 Jul 28 06:43:52.352638 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 478/955] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:52 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:52.357265 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a0bdd4ec-c1be-42d3-b5cb-71c7850f6e66 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 200 len: 1311 microversion: 2.1 time: 0.107997 Jul 28 06:43:52.357911 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 478/956] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:52 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:52.685420 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9732d2b8-9369-4207-a2a4-d82849f4f9f2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:52.685916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9732d2b8-9369-4207-a2a4-d82849f4f9f2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:52.701754 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9732d2b8-9369-4207-a2a4-d82849f4f9f2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:52.702129 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9732d2b8-9369-4207-a2a4-d82849f4f9f2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:52.702921 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9732d2b8-9369-4207-a2a4-d82849f4f9f2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:52.703359 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9732d2b8-9369-4207-a2a4-d82849f4f9f2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:52.730258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9732d2b8-9369-4207-a2a4-d82849f4f9f2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/ips" status: 200 len: 151 microversion: 2.20 time: 0.048749 Jul 28 06:43:52.731343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 479/957] 10.222.0.20 () {60 vars in 1289 bytes} [Thu Jul 28 06:43:52 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:43:52.780137 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-b090c03a-3f91-40fa-b536-0ade22975e8c req-c27604ef-3578-4a9f-8418-e15c66e6d706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d535ac71-ff1d-4f41-95b0-6c780e3b0ed1", "name": "network-vif-plugged", "status": "completed", "tag": "3085368c-234d-4061-8c70-32b4923f475e"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:52.799055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-b090c03a-3f91-40fa-b536-0ade22975e8c req-c27604ef-3578-4a9f-8418-e15c66e6d706 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:52.800043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-b090c03a-3f91-40fa-b536-0ade22975e8c req-c27604ef-3578-4a9f-8418-e15c66e6d706 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:52.811799 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-b090c03a-3f91-40fa-b536-0ade22975e8c req-c27604ef-3578-4a9f-8418-e15c66e6d706 service nova] Creating event network-vif-plugged:3085368c-234d-4061-8c70-32b4923f475e for instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 on hv-cinder-85060 Jul 28 06:43:52.818355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-b090c03a-3f91-40fa-b536-0ade22975e8c req-c27604ef-3578-4a9f-8418-e15c66e6d706 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040541 Jul 28 06:43:52.819258 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 479/958] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:43:53.374171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-31614f90-e7eb-45e0-93c2-c388baf90692 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:53.374785 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-31614f90-e7eb-45e0-93c2-c388baf90692 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:53.379594 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c8627a5f-718b-4c21-95d5-9d0101ed6c3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:53.380432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c8627a5f-718b-4c21-95d5-9d0101ed6c3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:53.381262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-31614f90-e7eb-45e0-93c2-c388baf90692 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:53.381748 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-31614f90-e7eb-45e0-93c2-c388baf90692 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:53.382519 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-31614f90-e7eb-45e0-93c2-c388baf90692 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:53.382951 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-31614f90-e7eb-45e0-93c2-c388baf90692 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:53.387429 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8627a5f-718b-4c21-95d5-9d0101ed6c3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:53.387887 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8627a5f-718b-4c21-95d5-9d0101ed6c3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:53.388662 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8627a5f-718b-4c21-95d5-9d0101ed6c3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:53.389114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c8627a5f-718b-4c21-95d5-9d0101ed6c3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:53.402859 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-c8627a5f-718b-4c21-95d5-9d0101ed6c3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] HTTP exception thrown: Instance 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc could not be found. Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c8627a5f-718b-4c21-95d5-9d0101ed6c3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Request method failure captured: Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc HTTP/1.1 Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6gL3NkHM14I48tiw5dWARRiVlSX6hjzNDYLhrttt-VpWAx6eXR5kUxZBDUlxCkX-fjq73lfPcjtweW5Eo4lRq0y_dlqVzl41Z6FONmvJzGg1r1nfLlC1eo1-rYp9LQrqHOfMHzFaI4teQM8o0fNLhLpKdrVeIXiaMq8dsMMjOvMfQ Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: 0fb2f4ad616e43f5a9a248390bd0aebf Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:43:53.404508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fb2f4ad616e43f5a9a248390bd0aebf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fb2f4ad616e43f5a9a248390bd0aebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fb2f4ad616e43f5a9a248390bd0aebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fb2f4ad616e43f5a9a248390bd0aebf"}]}] Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: 0fb2f4ad616e43f5a9a248390bd0aebf Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-ServerRescueNegativeTestJSON-690058944-project Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: a2080efc6cbd471995593012bc268765 Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690058944-project Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc could not be found. Jul 28 06:43:53.406077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '2fd097e6-598d-42a1-a3ad-5d8716bcb7fc'} Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc could not be found. Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:43:53.406897 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc could not be found. Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc could not be found. Jul 28 06:43:53.408443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:53.409641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c8627a5f-718b-4c21-95d5-9d0101ed6c3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Returning 404 to user: Instance 2fd097e6-598d-42a1-a3ad-5d8716bcb7fc could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:43:53.409641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c8627a5f-718b-4c21-95d5-9d0101ed6c3e tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc" status: 404 len: 111 microversion: 2.1 time: 0.030994 Jul 28 06:43:53.409641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 480/959] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:53 2022] GET /compute/v2.1/servers/2fd097e6-598d-42a1-a3ad-5d8716bcb7fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:43:53.414587 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-67203a00-0db5-4152-9d76-e953629ac999 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:53.415241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-67203a00-0db5-4152-9d76-e953629ac999 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:53.421456 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67203a00-0db5-4152-9d76-e953629ac999 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:53.421913 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67203a00-0db5-4152-9d76-e953629ac999 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:53.422693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67203a00-0db5-4152-9d76-e953629ac999 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:53.423136 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-67203a00-0db5-4152-9d76-e953629ac999 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:53.451771 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-67203a00-0db5-4152-9d76-e953629ac999 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Going to try to terminate instance {{(pid=124563) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:43:53.531340 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-31614f90-e7eb-45e0-93c2-c388baf90692 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:53.544914 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-31614f90-e7eb-45e0-93c2-c388baf90692 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1367 microversion: 2.1 time: 0.174241 Jul 28 06:43:53.545892 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 480/960] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:53 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:53.556009 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-67203a00-0db5-4152-9d76-e953629ac999 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 204 len: 0 microversion: 2.1 time: 0.144216 Jul 28 06:43:53.556851 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 481/961] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:43:53 2022] DELETE /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:43:53.564907 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5627ddd5-8e42-4340-a174-96ff49969215 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:53.565747 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5627ddd5-8e42-4340-a174-96ff49969215 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:53.573872 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5627ddd5-8e42-4340-a174-96ff49969215 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:53.574324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5627ddd5-8e42-4340-a174-96ff49969215 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:53.575093 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5627ddd5-8e42-4340-a174-96ff49969215 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:53.575528 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5627ddd5-8e42-4340-a174-96ff49969215 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:53.709200 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5627ddd5-8e42-4340-a174-96ff49969215 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:53.716625 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5627ddd5-8e42-4340-a174-96ff49969215 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.155777 Jul 28 06:43:53.717180 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 481/962] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:53 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:54.569116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-384b3199-209a-4b6d-9a6e-5e9a8471037f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:54.569858 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-384b3199-209a-4b6d-9a6e-5e9a8471037f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:54.576370 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-384b3199-209a-4b6d-9a6e-5e9a8471037f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:54.576838 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-384b3199-209a-4b6d-9a6e-5e9a8471037f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:54.577638 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-384b3199-209a-4b6d-9a6e-5e9a8471037f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:54.578070 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-384b3199-209a-4b6d-9a6e-5e9a8471037f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:54.709092 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-384b3199-209a-4b6d-9a6e-5e9a8471037f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:54.717031 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-384b3199-209a-4b6d-9a6e-5e9a8471037f tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1367 microversion: 2.1 time: 0.152369 Jul 28 06:43:54.717626 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 482/963] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:54 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:54.737988 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-792a97d3-89ac-4026-88d5-1f972b8a4821 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:54.738597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-792a97d3-89ac-4026-88d5-1f972b8a4821 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:54.746205 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-792a97d3-89ac-4026-88d5-1f972b8a4821 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:54.746650 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-792a97d3-89ac-4026-88d5-1f972b8a4821 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:54.747446 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-792a97d3-89ac-4026-88d5-1f972b8a4821 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:54.747881 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-792a97d3-89ac-4026-88d5-1f972b8a4821 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:54.876889 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-792a97d3-89ac-4026-88d5-1f972b8a4821 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:54.884273 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-792a97d3-89ac-4026-88d5-1f972b8a4821 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.150121 Jul 28 06:43:54.884819 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 482/964] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:54 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:55.080278 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-41315b32-f056-4668-9532-6269dec61019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:55.080820 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-41315b32-f056-4668-9532-6269dec61019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:55.087805 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41315b32-f056-4668-9532-6269dec61019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:55.088355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41315b32-f056-4668-9532-6269dec61019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:55.089139 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41315b32-f056-4668-9532-6269dec61019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:55.089613 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41315b32-f056-4668-9532-6269dec61019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:55.112927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-41315b32-f056-4668-9532-6269dec61019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lazy-loading 'flavor' on Instance uuid 163a335a-d407-4ec6-9c94-f0d8e37e83d4 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:43:55.116684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:55.292677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-41315b32-f056-4668-9532-6269dec61019 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "POST /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/action" status: 202 len: 0 microversion: 2.20 time: 0.216163 Jul 28 06:43:55.293265 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 483/965] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Jul 28 06:43:55 2022] POST /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:43:55.301485 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cdf5d85c-d562-4311-9e49-8b019030a57c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:55.302103 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cdf5d85c-d562-4311-9e49-8b019030a57c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:55.308056 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cdf5d85c-d562-4311-9e49-8b019030a57c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:55.308502 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cdf5d85c-d562-4311-9e49-8b019030a57c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:55.309361 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cdf5d85c-d562-4311-9e49-8b019030a57c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:55.309801 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cdf5d85c-d562-4311-9e49-8b019030a57c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:55.441508 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cdf5d85c-d562-4311-9e49-8b019030a57c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:55.450184 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cdf5d85c-d562-4311-9e49-8b019030a57c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:55.451691 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cdf5d85c-d562-4311-9e49-8b019030a57c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:55.452846 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cdf5d85c-d562-4311-9e49-8b019030a57c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.155289 Jul 28 06:43:55.453418 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 483/966] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:55 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:43:55.739439 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-94b1a4e9-81cb-45e8-a41c-eb9595ead533 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:55.740155 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-94b1a4e9-81cb-45e8-a41c-eb9595ead533 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:55.748004 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-94b1a4e9-81cb-45e8-a41c-eb9595ead533 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:55.748453 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-94b1a4e9-81cb-45e8-a41c-eb9595ead533 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:55.749225 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-94b1a4e9-81cb-45e8-a41c-eb9595ead533 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:55.749691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-94b1a4e9-81cb-45e8-a41c-eb9595ead533 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:55.890171 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-94b1a4e9-81cb-45e8-a41c-eb9595ead533 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:55.897596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-94b1a4e9-81cb-45e8-a41c-eb9595ead533 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1367 microversion: 2.1 time: 0.162867 Jul 28 06:43:55.898163 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 484/967] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:55 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:55.904839 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-20ff313b-91dd-44aa-9acc-74f61448e1f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:55.905483 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-20ff313b-91dd-44aa-9acc-74f61448e1f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:55.912196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20ff313b-91dd-44aa-9acc-74f61448e1f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:55.912649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20ff313b-91dd-44aa-9acc-74f61448e1f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:55.913438 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20ff313b-91dd-44aa-9acc-74f61448e1f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:55.913877 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-20ff313b-91dd-44aa-9acc-74f61448e1f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:55.916654 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:43:56.043782 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-20ff313b-91dd-44aa-9acc-74f61448e1f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:56.051287 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-20ff313b-91dd-44aa-9acc-74f61448e1f2 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.150336 Jul 28 06:43:56.051844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 484/968] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:55 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:56.475972 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9b38349a-1e3e-4b57-9a83-4802fce1e280 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:56.476620 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9b38349a-1e3e-4b57-9a83-4802fce1e280 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:56.483915 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9b38349a-1e3e-4b57-9a83-4802fce1e280 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:56.484365 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9b38349a-1e3e-4b57-9a83-4802fce1e280 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:56.485162 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9b38349a-1e3e-4b57-9a83-4802fce1e280 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:56.485626 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9b38349a-1e3e-4b57-9a83-4802fce1e280 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:56.621833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9b38349a-1e3e-4b57-9a83-4802fce1e280 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:56.629890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9b38349a-1e3e-4b57-9a83-4802fce1e280 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:56.631410 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9b38349a-1e3e-4b57-9a83-4802fce1e280 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:56.632579 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9b38349a-1e3e-4b57-9a83-4802fce1e280 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.160520 Jul 28 06:43:56.633135 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 485/969] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:56 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:43:56.918936 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7ca14aef-7f9d-410b-b52b-2bdf7227b3b2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:56.919546 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7ca14aef-7f9d-410b-b52b-2bdf7227b3b2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:56.926032 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ca14aef-7f9d-410b-b52b-2bdf7227b3b2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:56.926474 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ca14aef-7f9d-410b-b52b-2bdf7227b3b2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:56.927230 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ca14aef-7f9d-410b-b52b-2bdf7227b3b2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:56.927655 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7ca14aef-7f9d-410b-b52b-2bdf7227b3b2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:57.059940 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7ca14aef-7f9d-410b-b52b-2bdf7227b3b2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:57.067995 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7ca14aef-7f9d-410b-b52b-2bdf7227b3b2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1367 microversion: 2.1 time: 0.153156 Jul 28 06:43:57.081318 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 485/970] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:56 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:57.081523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1650b09f-3e3b-480d-8224-9704f35ed788 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:57.081523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1650b09f-3e3b-480d-8224-9704f35ed788 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:57.081523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1650b09f-3e3b-480d-8224-9704f35ed788 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:57.081523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1650b09f-3e3b-480d-8224-9704f35ed788 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:57.082272 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1650b09f-3e3b-480d-8224-9704f35ed788 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:57.082690 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1650b09f-3e3b-480d-8224-9704f35ed788 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:57.221147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1650b09f-3e3b-480d-8224-9704f35ed788 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:57.228700 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1650b09f-3e3b-480d-8224-9704f35ed788 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1521 microversion: 2.1 time: 0.160370 Jul 28 06:43:57.229273 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 486/971] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:57 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:57.655929 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b55db7a2-3a78-4a95-bf1b-05e13eec9b30 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:57.656537 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b55db7a2-3a78-4a95-bf1b-05e13eec9b30 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:57.662672 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b55db7a2-3a78-4a95-bf1b-05e13eec9b30 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:57.663126 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b55db7a2-3a78-4a95-bf1b-05e13eec9b30 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:57.663903 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b55db7a2-3a78-4a95-bf1b-05e13eec9b30 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:57.664341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b55db7a2-3a78-4a95-bf1b-05e13eec9b30 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:57.883190 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b55db7a2-3a78-4a95-bf1b-05e13eec9b30 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:57.891368 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b55db7a2-3a78-4a95-bf1b-05e13eec9b30 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:57.892933 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b55db7a2-3a78-4a95-bf1b-05e13eec9b30 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:57.894123 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b55db7a2-3a78-4a95-bf1b-05e13eec9b30 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.242135 Jul 28 06:43:57.894683 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 486/972] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:57 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:43:58.092131 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5272a25f-2bd2-4569-99a2-e429180c3a90 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:58.092826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5272a25f-2bd2-4569-99a2-e429180c3a90 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:58.100360 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5272a25f-2bd2-4569-99a2-e429180c3a90 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:58.100980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5272a25f-2bd2-4569-99a2-e429180c3a90 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:58.102438 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5272a25f-2bd2-4569-99a2-e429180c3a90 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:58.103592 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5272a25f-2bd2-4569-99a2-e429180c3a90 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:58.107536 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-f8259340-40be-4c69-8c6f-8294fecfbd3b req-ed08e582-01d3-4059-9126-dca245681623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759d9d29-e67f-49e4-986a-5d71340fd0c3", "name": "network-vif-deleted", "tag": "1af3bbc2-bb75-4b78-b8d2-211da789e581"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:58.119996 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-f8259340-40be-4c69-8c6f-8294fecfbd3b req-ed08e582-01d3-4059-9126-dca245681623 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:58.120469 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-f8259340-40be-4c69-8c6f-8294fecfbd3b req-ed08e582-01d3-4059-9126-dca245681623 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:58.132891 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-f8259340-40be-4c69-8c6f-8294fecfbd3b req-ed08e582-01d3-4059-9126-dca245681623 service nova] Creating event network-vif-deleted:1af3bbc2-bb75-4b78-b8d2-211da789e581 for instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 on hv-cinder-85060 Jul 28 06:43:58.138945 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-f8259340-40be-4c69-8c6f-8294fecfbd3b req-ed08e582-01d3-4059-9126-dca245681623 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036277 Jul 28 06:43:58.140029 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 487/973] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:43:58.245230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5272a25f-2bd2-4569-99a2-e429180c3a90 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:58.253147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5272a25f-2bd2-4569-99a2-e429180c3a90 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1556 microversion: 2.1 time: 0.165404 Jul 28 06:43:58.253646 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:58.254379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:58.261506 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:58.261960 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:58.262773 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:58.263207 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:58.265711 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 487/974] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:58 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:43:58.275368 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-79accad5-6504-4a6d-b277-caff325a6042 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:58.276081 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-79accad5-6504-4a6d-b277-caff325a6042 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:58.282927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79accad5-6504-4a6d-b277-caff325a6042 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:58.283418 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79accad5-6504-4a6d-b277-caff325a6042 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:58.284317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79accad5-6504-4a6d-b277-caff325a6042 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:58.284820 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-79accad5-6504-4a6d-b277-caff325a6042 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:58.299011 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:58.299475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:58.299935 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lazy-loading 'fault' on Instance uuid 759d9d29-e67f-49e4-986a-5d71340fd0c3 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:43:58.349379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2080efc6cbd471995593012bc268765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f4ad616e43f5a9a248390bd0aebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:58.356830 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c0cd379d-c43c-4f53-af34-fdb50903e187 tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 200 len: 1311 microversion: 2.1 time: 0.108227 Jul 28 06:43:58.357746 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 488/975] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:58 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:43:58.367643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-79accad5-6504-4a6d-b277-caff325a6042 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096694 Jul 28 06:43:58.368451 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 488/976] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Jul 28 06:43:58 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:43:58.919744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-def89d3d-334a-47c2-aa70-0454c1298a33 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:58.920285 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-def89d3d-334a-47c2-aa70-0454c1298a33 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:58.927096 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-def89d3d-334a-47c2-aa70-0454c1298a33 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:58.927693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-def89d3d-334a-47c2-aa70-0454c1298a33 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:58.928476 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-def89d3d-334a-47c2-aa70-0454c1298a33 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:58.928912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-def89d3d-334a-47c2-aa70-0454c1298a33 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:59.064325 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-def89d3d-334a-47c2-aa70-0454c1298a33 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:59.073065 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-def89d3d-334a-47c2-aa70-0454c1298a33 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:59.074610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-def89d3d-334a-47c2-aa70-0454c1298a33 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:43:59.075771 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-def89d3d-334a-47c2-aa70-0454c1298a33 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.161258 Jul 28 06:43:59.076330 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 489/977] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:43:58 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:43:59.378723 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5697754c-5cba-4237-bcda-fdb4a855e18c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:43:59.379395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5697754c-5cba-4237-bcda-fdb4a855e18c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] [instance: 759d9d29-e67f-49e4-986a-5d71340fd0c3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:43:59.386149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5697754c-5cba-4237-bcda-fdb4a855e18c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:59.386598 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5697754c-5cba-4237-bcda-fdb4a855e18c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:59.387495 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5697754c-5cba-4237-bcda-fdb4a855e18c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:59.387937 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5697754c-5cba-4237-bcda-fdb4a855e18c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:59.401356 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-5697754c-5cba-4237-bcda-fdb4a855e18c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] HTTP exception thrown: Instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 could not be found. Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5697754c-5cba-4237-bcda-fdb4a855e18c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Request method failure captured: Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 HTTP/1.1 Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6gL3NkHM14I48tiw5dWARRiVlSX6hjzNDYLhrttt-VpWAx6eXR5kUxZBDUlxCkX-fjq73lfPcjtweW5Eo4lRq0y_dlqVzl41Z6FONmvJzGg1r1nfLlC1eo1-rYp9LQrqHOfMHzFaI4teQM8o0fNLhLpKdrVeIXiaMq8dsMMjOvMfQ Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: 0fb2f4ad616e43f5a9a248390bd0aebf Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:43:59.403041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fb2f4ad616e43f5a9a248390bd0aebf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fb2f4ad616e43f5a9a248390bd0aebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fb2f4ad616e43f5a9a248390bd0aebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fb2f4ad616e43f5a9a248390bd0aebf"}]}] Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: 0fb2f4ad616e43f5a9a248390bd0aebf Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690058944 Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-ServerRescueNegativeTestJSON-690058944-project Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: a2080efc6cbd471995593012bc268765 Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690058944-project Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 could not be found. Jul 28 06:43:59.405857 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '759d9d29-e67f-49e4-986a-5d71340fd0c3'} Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 could not be found. Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:43:59.407467 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 could not be found. Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 could not be found. Jul 28 06:43:59.409992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:43:59.412349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5697754c-5cba-4237-bcda-fdb4a855e18c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] Returning 404 to user: Instance 759d9d29-e67f-49e4-986a-5d71340fd0c3 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:43:59.412349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5697754c-5cba-4237-bcda-fdb4a855e18c tempest-ServerRescueNegativeTestJSON-690058944 tempest-ServerRescueNegativeTestJSON-690058944-project] 10.222.0.20 "GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3" status: 404 len: 111 microversion: 2.1 time: 0.030082 Jul 28 06:43:59.412349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 489/978] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:43:59 2022] GET /compute/v2.1/servers/759d9d29-e67f-49e4-986a-5d71340fd0c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:43:59.592479 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-c1d6c2a3-5f24-4d0f-b39d-174b7610e004 req-1dd117fb-4e7d-42c8-afef-a6c800088eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d535ac71-ff1d-4f41-95b0-6c780e3b0ed1", "tag": "3085368c-234d-4061-8c70-32b4923f475e"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:43:59.602532 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-c1d6c2a3-5f24-4d0f-b39d-174b7610e004 req-1dd117fb-4e7d-42c8-afef-a6c800088eff service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:43:59.603072 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-c1d6c2a3-5f24-4d0f-b39d-174b7610e004 req-1dd117fb-4e7d-42c8-afef-a6c800088eff service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:43:59.614524 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-c1d6c2a3-5f24-4d0f-b39d-174b7610e004 req-1dd117fb-4e7d-42c8-afef-a6c800088eff service nova] Creating event network-changed:3085368c-234d-4061-8c70-32b4923f475e for instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 on hv-cinder-85060 Jul 28 06:43:59.620636 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-c1d6c2a3-5f24-4d0f-b39d-174b7610e004 req-1dd117fb-4e7d-42c8-afef-a6c800088eff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033241 Jul 28 06:43:59.621491 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 490/979] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:44:00.106490 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2b9ca1df-496d-45a1-b9aa-2868f4d054a5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:00.107532 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2b9ca1df-496d-45a1-b9aa-2868f4d054a5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:00.114910 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b9ca1df-496d-45a1-b9aa-2868f4d054a5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:00.116660 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b9ca1df-496d-45a1-b9aa-2868f4d054a5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:00.117713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b9ca1df-496d-45a1-b9aa-2868f4d054a5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:00.119375 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b9ca1df-496d-45a1-b9aa-2868f4d054a5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:00.386464 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2b9ca1df-496d-45a1-b9aa-2868f4d054a5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:00.395148 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2b9ca1df-496d-45a1-b9aa-2868f4d054a5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:00.396780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2b9ca1df-496d-45a1-b9aa-2868f4d054a5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:00.399617 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2b9ca1df-496d-45a1-b9aa-2868f4d054a5 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.302556 Jul 28 06:44:00.400982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 490/980] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:00 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:01.425043 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-82af1633-08c7-4241-9fc8-7d64a1ca39d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:01.425773 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-82af1633-08c7-4241-9fc8-7d64a1ca39d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:01.437889 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-82af1633-08c7-4241-9fc8-7d64a1ca39d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:01.438631 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-82af1633-08c7-4241-9fc8-7d64a1ca39d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:01.439668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-82af1633-08c7-4241-9fc8-7d64a1ca39d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:01.440284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-82af1633-08c7-4241-9fc8-7d64a1ca39d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:01.611528 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-82af1633-08c7-4241-9fc8-7d64a1ca39d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:01.631438 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-82af1633-08c7-4241-9fc8-7d64a1ca39d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:01.633178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-82af1633-08c7-4241-9fc8-7d64a1ca39d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:01.635538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-82af1633-08c7-4241-9fc8-7d64a1ca39d2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.215797 Jul 28 06:44:01.636685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 491/981] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:01 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:02.659164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-09d5e029-82eb-4b19-97d6-fa7b017c40f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:02.660126 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-09d5e029-82eb-4b19-97d6-fa7b017c40f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:02.667951 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09d5e029-82eb-4b19-97d6-fa7b017c40f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:02.668531 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09d5e029-82eb-4b19-97d6-fa7b017c40f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:02.669569 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09d5e029-82eb-4b19-97d6-fa7b017c40f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:02.670005 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-09d5e029-82eb-4b19-97d6-fa7b017c40f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:02.900099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-09d5e029-82eb-4b19-97d6-fa7b017c40f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:02.912608 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-09d5e029-82eb-4b19-97d6-fa7b017c40f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:02.915379 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-09d5e029-82eb-4b19-97d6-fa7b017c40f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:02.916656 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-09d5e029-82eb-4b19-97d6-fa7b017c40f8 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.261746 Jul 28 06:44:02.917355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 491/982] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:02 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:03.940474 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c0d35c56-8eb6-4844-95cb-57590b6d9b29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:03.941090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c0d35c56-8eb6-4844-95cb-57590b6d9b29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:03.944167 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:03.950546 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c0d35c56-8eb6-4844-95cb-57590b6d9b29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:03.951004 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c0d35c56-8eb6-4844-95cb-57590b6d9b29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:03.951783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c0d35c56-8eb6-4844-95cb-57590b6d9b29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:03.952335 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c0d35c56-8eb6-4844-95cb-57590b6d9b29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:04.095201 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c0d35c56-8eb6-4844-95cb-57590b6d9b29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:04.103307 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c0d35c56-8eb6-4844-95cb-57590b6d9b29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:04.104797 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c0d35c56-8eb6-4844-95cb-57590b6d9b29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:04.106025 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c0d35c56-8eb6-4844-95cb-57590b6d9b29 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.169847 Jul 28 06:44:04.106572 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 492/983] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:03 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:05.131077 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0dc09ee8-3683-42f3-9bf4-7b7a13301b9d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:05.132373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0dc09ee8-3683-42f3-9bf4-7b7a13301b9d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:05.140619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0dc09ee8-3683-42f3-9bf4-7b7a13301b9d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:05.141331 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0dc09ee8-3683-42f3-9bf4-7b7a13301b9d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:05.142122 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0dc09ee8-3683-42f3-9bf4-7b7a13301b9d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:05.142566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0dc09ee8-3683-42f3-9bf4-7b7a13301b9d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:05.427067 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0dc09ee8-3683-42f3-9bf4-7b7a13301b9d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:05.439465 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0dc09ee8-3683-42f3-9bf4-7b7a13301b9d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:05.441326 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0dc09ee8-3683-42f3-9bf4-7b7a13301b9d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:05.442789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0dc09ee8-3683-42f3-9bf4-7b7a13301b9d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.315821 Jul 28 06:44:05.443505 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 492/984] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:05 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:06.465530 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b7ebe7ab-0f02-4ee7-9446-cd71bf19b34c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:06.466514 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b7ebe7ab-0f02-4ee7-9446-cd71bf19b34c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:06.473547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ebe7ab-0f02-4ee7-9446-cd71bf19b34c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:06.474114 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ebe7ab-0f02-4ee7-9446-cd71bf19b34c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:06.474966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ebe7ab-0f02-4ee7-9446-cd71bf19b34c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:06.475514 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ebe7ab-0f02-4ee7-9446-cd71bf19b34c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:06.623192 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b7ebe7ab-0f02-4ee7-9446-cd71bf19b34c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:06.631363 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b7ebe7ab-0f02-4ee7-9446-cd71bf19b34c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:06.632856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b7ebe7ab-0f02-4ee7-9446-cd71bf19b34c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:06.634390 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b7ebe7ab-0f02-4ee7-9446-cd71bf19b34c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.172741 Jul 28 06:44:06.634948 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 493/985] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:06 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:07.658209 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f1a8022a-7ed8-4afc-bc8e-cf09f9a96919 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:07.659412 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f1a8022a-7ed8-4afc-bc8e-cf09f9a96919 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:07.667168 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f1a8022a-7ed8-4afc-bc8e-cf09f9a96919 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:07.668644 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f1a8022a-7ed8-4afc-bc8e-cf09f9a96919 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:07.669497 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f1a8022a-7ed8-4afc-bc8e-cf09f9a96919 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:07.669949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f1a8022a-7ed8-4afc-bc8e-cf09f9a96919 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:07.913354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f1a8022a-7ed8-4afc-bc8e-cf09f9a96919 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:07.925075 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f1a8022a-7ed8-4afc-bc8e-cf09f9a96919 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:07.926931 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f1a8022a-7ed8-4afc-bc8e-cf09f9a96919 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:07.928203 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f1a8022a-7ed8-4afc-bc8e-cf09f9a96919 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.273906 Jul 28 06:44:07.944994 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 493/986] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:07 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:08.831125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-701424e6-2b2d-4fc8-96e0-e63fb24016ba tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'create', calling method: .version_select at 0x7f5747552d30>, body: {"keypair": {"name": "tempest-keypair-43259339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSP3NOricHI7LjEnFEbeGWq+8kBOxzIOag+Go8gtgFL/TGKeMCWPcJfb1TNkZB30L6cxgeoAWzpwbnhpnU+CM+u4CjUSpZfsMcl8eggDn9Qs3soMsALplHscVpNrIpC3w=="}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:08.847307 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-701424e6-2b2d-4fc8-96e0-e63fb24016ba tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Getting quotas for project f0f65f082a2547f79ac218e318bee171. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:44:08.851332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-701424e6-2b2d-4fc8-96e0-e63fb24016ba tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Getting quotas for user a87b79d20f0f4194a99fc342c9b14aa2 and project f0f65f082a2547f79ac218e318bee171. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:44:08.874898 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-701424e6-2b2d-4fc8-96e0-e63fb24016ba tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.167214 Jul 28 06:44:08.875432 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 494/987] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Jul 28 06:44:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:44:08.953579 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3e8c804e-9c6e-471a-a925-80a016357aa6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:08.955355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3e8c804e-9c6e-471a-a925-80a016357aa6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:08.964317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3e8c804e-9c6e-471a-a925-80a016357aa6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:08.964796 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3e8c804e-9c6e-471a-a925-80a016357aa6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:08.966002 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3e8c804e-9c6e-471a-a925-80a016357aa6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:08.966693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3e8c804e-9c6e-471a-a925-80a016357aa6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:09.190596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3e8c804e-9c6e-471a-a925-80a016357aa6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:09.204770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3e8c804e-9c6e-471a-a925-80a016357aa6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:09.206757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3e8c804e-9c6e-471a-a925-80a016357aa6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:09.208091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3e8c804e-9c6e-471a-a925-80a016357aa6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.258617 Jul 28 06:44:09.208994 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 494/988] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:08 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:10.233558 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-45734a94-335a-4858-9a39-e6b4b4f2ed08 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:10.235055 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-45734a94-335a-4858-9a39-e6b4b4f2ed08 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:10.244143 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-45734a94-335a-4858-9a39-e6b4b4f2ed08 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:10.244883 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-45734a94-335a-4858-9a39-e6b4b4f2ed08 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:10.246160 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-45734a94-335a-4858-9a39-e6b4b4f2ed08 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:10.247070 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-45734a94-335a-4858-9a39-e6b4b4f2ed08 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:10.306207 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-706071720", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "442c4b1f-6d7c-47a3-b9fa-bb78bfc76a0d"}], "security_groups": [{"name": "tempest-securitygroup--387450998"}], "key_name": "tempest-keypair-43259339", "user_data": "}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:10.393385 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-45734a94-335a-4858-9a39-e6b4b4f2ed08 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:10.402457 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-45734a94-335a-4858-9a39-e6b4b4f2ed08 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:10.403956 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-45734a94-335a-4858-9a39-e6b4b4f2ed08 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:10.405123 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-45734a94-335a-4858-9a39-e6b4b4f2ed08 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.175771 Jul 28 06:44:10.406018 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 495/989] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:10 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:10.423634 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] validate_networks() for [('442c4b1f-6d7c-47a3-b9fa-bb78bfc76a0d', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:44:10.809663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:44:10.810091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:44:10.810567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:44:10.811120 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:44:10.811770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:44:10.821069 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:10.821564 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:10.822372 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:10.822818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:10.840081 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Getting quotas for project f0f65f082a2547f79ac218e318bee171. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:44:10.844073 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Getting quotas for user a87b79d20f0f4194a99fc342c9b14aa2 and project f0f65f082a2547f79ac218e318bee171. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:44:10.856212 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:44:10.858569 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:44:10.905392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1edb6e3c-4d40-4e99-bf22-50789e4ea93c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.604108 Jul 28 06:44:10.906028 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 495/990] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:44:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 06:44:10.917442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c18553ac-f4bb-4228-88b6-54191344f798 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:10.918047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c18553ac-f4bb-4228-88b6-54191344f798 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:10.988708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c18553ac-f4bb-4228-88b6-54191344f798 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:10.998178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c18553ac-f4bb-4228-88b6-54191344f798 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1235 microversion: 2.1 time: 0.085207 Jul 28 06:44:10.998689 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 496/991] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:10 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1235 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:11.434716 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-375cb766-87f6-42e0-9159-191c3d0a4390 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:11.436101 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-375cb766-87f6-42e0-9159-191c3d0a4390 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:11.449244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-375cb766-87f6-42e0-9159-191c3d0a4390 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:11.450145 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-375cb766-87f6-42e0-9159-191c3d0a4390 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:11.451239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-375cb766-87f6-42e0-9159-191c3d0a4390 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:11.452027 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-375cb766-87f6-42e0-9159-191c3d0a4390 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:11.728317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-375cb766-87f6-42e0-9159-191c3d0a4390 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:11.737879 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-375cb766-87f6-42e0-9159-191c3d0a4390 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:11.739777 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-375cb766-87f6-42e0-9159-191c3d0a4390 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:11.741242 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-375cb766-87f6-42e0-9159-191c3d0a4390 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.312168 Jul 28 06:44:11.742521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 496/992] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:11 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:12.018392 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-8d068a8b-98e5-4c32-939e-0dbe19ce709a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:12.019174 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-8d068a8b-98e5-4c32-939e-0dbe19ce709a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:12.027134 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8d068a8b-98e5-4c32-939e-0dbe19ce709a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:12.027591 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8d068a8b-98e5-4c32-939e-0dbe19ce709a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:12.028378 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8d068a8b-98e5-4c32-939e-0dbe19ce709a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:12.028819 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8d068a8b-98e5-4c32-939e-0dbe19ce709a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:12.101797 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8d068a8b-98e5-4c32-939e-0dbe19ce709a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:12.111263 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-8d068a8b-98e5-4c32-939e-0dbe19ce709a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1287 microversion: 2.1 time: 0.096833 Jul 28 06:44:12.111839 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 497/993] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:12 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:12.766751 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1ee35469-5d6d-490c-b9c0-3a0d515fd273 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:12.767453 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1ee35469-5d6d-490c-b9c0-3a0d515fd273 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:12.774959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1ee35469-5d6d-490c-b9c0-3a0d515fd273 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:12.775408 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1ee35469-5d6d-490c-b9c0-3a0d515fd273 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:12.776183 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1ee35469-5d6d-490c-b9c0-3a0d515fd273 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:12.776618 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1ee35469-5d6d-490c-b9c0-3a0d515fd273 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:12.909934 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1ee35469-5d6d-490c-b9c0-3a0d515fd273 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:12.918305 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1ee35469-5d6d-490c-b9c0-3a0d515fd273 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:12.920091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1ee35469-5d6d-490c-b9c0-3a0d515fd273 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:12.921402 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1ee35469-5d6d-490c-b9c0-3a0d515fd273 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1743 microversion: 2.20 time: 0.158642 Jul 28 06:44:12.921962 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 497/994] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:12 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:13.132078 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0f69a569-16e3-4212-b8a0-5b62d92f2eb8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:13.132691 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0f69a569-16e3-4212-b8a0-5b62d92f2eb8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:13.139856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0f69a569-16e3-4212-b8a0-5b62d92f2eb8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:13.140239 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0f69a569-16e3-4212-b8a0-5b62d92f2eb8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:13.141011 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0f69a569-16e3-4212-b8a0-5b62d92f2eb8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:13.141483 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0f69a569-16e3-4212-b8a0-5b62d92f2eb8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:13.207264 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0f69a569-16e3-4212-b8a0-5b62d92f2eb8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:13.215210 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0f69a569-16e3-4212-b8a0-5b62d92f2eb8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1293 microversion: 2.1 time: 0.087011 Jul 28 06:44:13.215782 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 498/995] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:13 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:13.946525 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3dbc716a-2964-4ea7-a486-42b84d70d9a6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:13.947131 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3dbc716a-2964-4ea7-a486-42b84d70d9a6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:13.963585 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dbc716a-2964-4ea7-a486-42b84d70d9a6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:13.964037 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dbc716a-2964-4ea7-a486-42b84d70d9a6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:13.964816 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dbc716a-2964-4ea7-a486-42b84d70d9a6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:13.965251 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dbc716a-2964-4ea7-a486-42b84d70d9a6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:14.044214 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-31fa6259-d2a9-4a97-8c35-17dbc17c51e3 req-63cad89e-02ee-4fb6-84e5-529a71878985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a696f5-5e72-43ab-ab80-76c7ff3a3266", "tag": "310d1b9d-3dfc-4fa0-b2aa-ffd999bcd30b"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:14.059911 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-31fa6259-d2a9-4a97-8c35-17dbc17c51e3 req-63cad89e-02ee-4fb6-84e5-529a71878985 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:14.060314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-31fa6259-d2a9-4a97-8c35-17dbc17c51e3 req-63cad89e-02ee-4fb6-84e5-529a71878985 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:14.081927 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-31fa6259-d2a9-4a97-8c35-17dbc17c51e3 req-63cad89e-02ee-4fb6-84e5-529a71878985 service nova] Creating event network-changed:310d1b9d-3dfc-4fa0-b2aa-ffd999bcd30b for instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 on hv-cinder-85060 Jul 28 06:44:14.089808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-31fa6259-d2a9-4a97-8c35-17dbc17c51e3 req-63cad89e-02ee-4fb6-84e5-529a71878985 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049535 Jul 28 06:44:14.090727 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 499/996] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:44:14.147459 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3dbc716a-2964-4ea7-a486-42b84d70d9a6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:14.157350 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3dbc716a-2964-4ea7-a486-42b84d70d9a6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:14.159305 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3dbc716a-2964-4ea7-a486-42b84d70d9a6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:14.160667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3dbc716a-2964-4ea7-a486-42b84d70d9a6 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1743 microversion: 2.20 time: 0.218983 Jul 28 06:44:14.174237 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 498/997] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:13 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1743 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:14.237113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ba471bcc-c2ec-4ea3-88ad-4ee852053574 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:14.237995 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ba471bcc-c2ec-4ea3-88ad-4ee852053574 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:14.245694 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ba471bcc-c2ec-4ea3-88ad-4ee852053574 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:14.246137 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ba471bcc-c2ec-4ea3-88ad-4ee852053574 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:14.246913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ba471bcc-c2ec-4ea3-88ad-4ee852053574 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:14.247349 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ba471bcc-c2ec-4ea3-88ad-4ee852053574 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:14.456201 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ba471bcc-c2ec-4ea3-88ad-4ee852053574 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:14.465122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ba471bcc-c2ec-4ea3-88ad-4ee852053574 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1360 microversion: 2.1 time: 0.232177 Jul 28 06:44:14.465738 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 500/998] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:14 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1360 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:15.186695 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-855f280b-f57e-4ddd-8b34-7debe8bb17fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:15.187328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-855f280b-f57e-4ddd-8b34-7debe8bb17fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:15.194046 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-855f280b-f57e-4ddd-8b34-7debe8bb17fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:15.194490 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-855f280b-f57e-4ddd-8b34-7debe8bb17fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:15.195263 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-855f280b-f57e-4ddd-8b34-7debe8bb17fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:15.195697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-855f280b-f57e-4ddd-8b34-7debe8bb17fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:15.337394 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-855f280b-f57e-4ddd-8b34-7debe8bb17fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:15.345257 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-855f280b-f57e-4ddd-8b34-7debe8bb17fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:15.346795 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-855f280b-f57e-4ddd-8b34-7debe8bb17fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:15.347958 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-855f280b-f57e-4ddd-8b34-7debe8bb17fd tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1738 microversion: 2.20 time: 0.165214 Jul 28 06:44:15.348508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 499/999] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:15 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:15.488043 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5813117d-d895-484b-8390-778ed1c71748 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:15.488715 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5813117d-d895-484b-8390-778ed1c71748 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:15.496119 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5813117d-d895-484b-8390-778ed1c71748 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:15.496572 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5813117d-d895-484b-8390-778ed1c71748 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:15.497369 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5813117d-d895-484b-8390-778ed1c71748 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:15.497810 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5813117d-d895-484b-8390-778ed1c71748 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:15.665457 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5813117d-d895-484b-8390-778ed1c71748 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:15.673785 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5813117d-d895-484b-8390-778ed1c71748 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1360 microversion: 2.1 time: 0.189719 Jul 28 06:44:15.674421 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 501/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:15 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1360 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:16.371478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-905f789d-e370-4319-9327-60fe74031363 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:16.371996 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-905f789d-e370-4319-9327-60fe74031363 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:16.378390 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-905f789d-e370-4319-9327-60fe74031363 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:16.378839 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-905f789d-e370-4319-9327-60fe74031363 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:16.380075 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-905f789d-e370-4319-9327-60fe74031363 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:16.380541 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-905f789d-e370-4319-9327-60fe74031363 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:16.383540 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:16.540328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-905f789d-e370-4319-9327-60fe74031363 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:16.548573 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-905f789d-e370-4319-9327-60fe74031363 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:16.550142 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-905f789d-e370-4319-9327-60fe74031363 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:16.551332 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-905f789d-e370-4319-9327-60fe74031363 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1738 microversion: 2.20 time: 0.184173 Jul 28 06:44:16.551887 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 500/1001] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:16 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:16.696136 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b527c210-1304-4ec7-992a-99c8624b9ec2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:16.696881 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b527c210-1304-4ec7-992a-99c8624b9ec2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:16.704197 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b527c210-1304-4ec7-992a-99c8624b9ec2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:16.704646 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b527c210-1304-4ec7-992a-99c8624b9ec2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:16.708436 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b527c210-1304-4ec7-992a-99c8624b9ec2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:16.708900 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b527c210-1304-4ec7-992a-99c8624b9ec2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:16.877172 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b527c210-1304-4ec7-992a-99c8624b9ec2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:16.886111 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b527c210-1304-4ec7-992a-99c8624b9ec2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1360 microversion: 2.1 time: 0.194850 Jul 28 06:44:16.900667 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 502/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:16 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1360 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:16.975837 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-cf737b66-8ea9-47f9-a45d-c7a34943e6cd req-abb9e965-7892-4f9f-93ea-17d9deb70692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163a335a-d407-4ec6-9c94-f0d8e37e83d4", "name": "network-vif-plugged", "status": "completed", "tag": "dc86c76c-8061-4d08-8a5f-ec9bba7801ad"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:16.990252 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-cf737b66-8ea9-47f9-a45d-c7a34943e6cd req-abb9e965-7892-4f9f-93ea-17d9deb70692 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:16.991168 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-cf737b66-8ea9-47f9-a45d-c7a34943e6cd req-abb9e965-7892-4f9f-93ea-17d9deb70692 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:17.009829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-cf737b66-8ea9-47f9-a45d-c7a34943e6cd req-abb9e965-7892-4f9f-93ea-17d9deb70692 service nova] Creating event network-vif-plugged:dc86c76c-8061-4d08-8a5f-ec9bba7801ad for instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 on hv-cinder-85060 Jul 28 06:44:17.017415 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-cf737b66-8ea9-47f9-a45d-c7a34943e6cd req-abb9e965-7892-4f9f-93ea-17d9deb70692 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044879 Jul 28 06:44:17.018577 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 501/1003] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:44:17.575549 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a7e505cc-d8ca-4bc9-9bbb-ce3d2adfed16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:17.576709 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a7e505cc-d8ca-4bc9-9bbb-ce3d2adfed16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:17.583396 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a7e505cc-d8ca-4bc9-9bbb-ce3d2adfed16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:17.583844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a7e505cc-d8ca-4bc9-9bbb-ce3d2adfed16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:17.584677 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a7e505cc-d8ca-4bc9-9bbb-ce3d2adfed16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:17.585134 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a7e505cc-d8ca-4bc9-9bbb-ce3d2adfed16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:17.736859 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a7e505cc-d8ca-4bc9-9bbb-ce3d2adfed16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:17.747336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a7e505cc-d8ca-4bc9-9bbb-ce3d2adfed16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:17.749222 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-a7e505cc-d8ca-4bc9-9bbb-ce3d2adfed16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:17.750798 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a7e505cc-d8ca-4bc9-9bbb-ce3d2adfed16 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1738 microversion: 2.20 time: 0.179038 Jul 28 06:44:17.751203 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 503/1004] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:17 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:17.907770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e07fb538-6dbe-4151-b193-99e809565c9f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:17.909120 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e07fb538-6dbe-4151-b193-99e809565c9f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:17.918293 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e07fb538-6dbe-4151-b193-99e809565c9f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:17.919022 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e07fb538-6dbe-4151-b193-99e809565c9f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:17.920044 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e07fb538-6dbe-4151-b193-99e809565c9f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:17.920649 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e07fb538-6dbe-4151-b193-99e809565c9f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:18.064351 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e07fb538-6dbe-4151-b193-99e809565c9f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:18.074345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e07fb538-6dbe-4151-b193-99e809565c9f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1360 microversion: 2.1 time: 0.171299 Jul 28 06:44:18.075820 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 502/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:17 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:18.775483 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b2f7acff-68fa-4c2a-93ed-4e40b3e721ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:18.776282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b2f7acff-68fa-4c2a-93ed-4e40b3e721ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:18.784618 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b2f7acff-68fa-4c2a-93ed-4e40b3e721ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:18.785475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b2f7acff-68fa-4c2a-93ed-4e40b3e721ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:18.787561 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b2f7acff-68fa-4c2a-93ed-4e40b3e721ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:18.788441 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b2f7acff-68fa-4c2a-93ed-4e40b3e721ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:18.814623 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:18.984789 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b2f7acff-68fa-4c2a-93ed-4e40b3e721ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:18.994571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b2f7acff-68fa-4c2a-93ed-4e40b3e721ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:18.996343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b2f7acff-68fa-4c2a-93ed-4e40b3e721ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:18.997823 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b2f7acff-68fa-4c2a-93ed-4e40b3e721ef tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1738 microversion: 2.20 time: 0.227304 Jul 28 06:44:19.003164 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 504/1006] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:18 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:19.039657 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-41e7d059-cf36-499c-974b-e118afd1245b req-86f0d6ca-9e83-4622-bc6f-134b902a1c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a696f5-5e72-43ab-ab80-76c7ff3a3266", "name": "network-vif-plugged", "status": "completed", "tag": "310d1b9d-3dfc-4fa0-b2aa-ffd999bcd30b"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:19.055499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-41e7d059-cf36-499c-974b-e118afd1245b req-86f0d6ca-9e83-4622-bc6f-134b902a1c49 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:19.055910 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-41e7d059-cf36-499c-974b-e118afd1245b req-86f0d6ca-9e83-4622-bc6f-134b902a1c49 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:19.067593 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-41e7d059-cf36-499c-974b-e118afd1245b req-86f0d6ca-9e83-4622-bc6f-134b902a1c49 service nova] Creating event network-vif-plugged:310d1b9d-3dfc-4fa0-b2aa-ffd999bcd30b for instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 on hv-cinder-85060 Jul 28 06:44:19.074978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-41e7d059-cf36-499c-974b-e118afd1245b req-86f0d6ca-9e83-4622-bc6f-134b902a1c49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039284 Jul 28 06:44:19.075575 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 503/1007] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:44:19.096887 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ae34d68c-0a80-4428-a4d2-742ab89a48f7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:19.097934 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ae34d68c-0a80-4428-a4d2-742ab89a48f7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:19.104762 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ae34d68c-0a80-4428-a4d2-742ab89a48f7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:19.105210 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ae34d68c-0a80-4428-a4d2-742ab89a48f7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:19.106181 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ae34d68c-0a80-4428-a4d2-742ab89a48f7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:19.106621 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ae34d68c-0a80-4428-a4d2-742ab89a48f7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:19.259081 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ae34d68c-0a80-4428-a4d2-742ab89a48f7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:19.268457 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ae34d68c-0a80-4428-a4d2-742ab89a48f7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1360 microversion: 2.1 time: 0.174302 Jul 28 06:44:19.268457 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 505/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:19 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:20.022207 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2d33a823-379a-4f09-bebb-4e121a21e005 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:20.022909 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2d33a823-379a-4f09-bebb-4e121a21e005 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:20.025718 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:20.033449 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d33a823-379a-4f09-bebb-4e121a21e005 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:20.033449 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d33a823-379a-4f09-bebb-4e121a21e005 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:20.033449 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d33a823-379a-4f09-bebb-4e121a21e005 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:20.033449 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2d33a823-379a-4f09-bebb-4e121a21e005 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:20.183882 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d33a823-379a-4f09-bebb-4e121a21e005 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:20.194566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d33a823-379a-4f09-bebb-4e121a21e005 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:20.196341 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2d33a823-379a-4f09-bebb-4e121a21e005 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:20.197735 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2d33a823-379a-4f09-bebb-4e121a21e005 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1738 microversion: 2.20 time: 0.180079 Jul 28 06:44:20.198618 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 504/1009] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:20 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:20.292245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ccfa0658-1cf4-4484-bf78-7996efa46920 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:20.292889 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ccfa0658-1cf4-4484-bf78-7996efa46920 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:20.299985 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ccfa0658-1cf4-4484-bf78-7996efa46920 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:20.300504 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ccfa0658-1cf4-4484-bf78-7996efa46920 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:20.301350 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ccfa0658-1cf4-4484-bf78-7996efa46920 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:20.301968 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ccfa0658-1cf4-4484-bf78-7996efa46920 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:20.449048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ccfa0658-1cf4-4484-bf78-7996efa46920 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:20.460258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ccfa0658-1cf4-4484-bf78-7996efa46920 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1360 microversion: 2.1 time: 0.172004 Jul 28 06:44:20.461352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 506/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:20 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:21.224231 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6a9e7410-447f-41ef-8115-b91f9f2e4e7d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:21.225986 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6a9e7410-447f-41ef-8115-b91f9f2e4e7d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:21.232206 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:21.233315 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=6 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:21.239850 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6a9e7410-447f-41ef-8115-b91f9f2e4e7d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:21.240600 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6a9e7410-447f-41ef-8115-b91f9f2e4e7d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:21.241704 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6a9e7410-447f-41ef-8115-b91f9f2e4e7d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:21.244271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6a9e7410-447f-41ef-8115-b91f9f2e4e7d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:21.395644 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6a9e7410-447f-41ef-8115-b91f9f2e4e7d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:21.403895 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6a9e7410-447f-41ef-8115-b91f9f2e4e7d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:21.405414 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6a9e7410-447f-41ef-8115-b91f9f2e4e7d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:21.409323 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6a9e7410-447f-41ef-8115-b91f9f2e4e7d tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1738 microversion: 2.20 time: 0.187775 Jul 28 06:44:21.409323 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 505/1011] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:21 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:21.483368 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2c2f6ea0-0c7a-4b4f-914d-78c35189d4d0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:21.484160 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2c2f6ea0-0c7a-4b4f-914d-78c35189d4d0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:21.486208 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=6 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:21.493313 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2c2f6ea0-0c7a-4b4f-914d-78c35189d4d0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:21.493767 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2c2f6ea0-0c7a-4b4f-914d-78c35189d4d0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:21.494567 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2c2f6ea0-0c7a-4b4f-914d-78c35189d4d0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:21.495006 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2c2f6ea0-0c7a-4b4f-914d-78c35189d4d0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:21.641054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2c2f6ea0-0c7a-4b4f-914d-78c35189d4d0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:21.653172 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2c2f6ea0-0c7a-4b4f-914d-78c35189d4d0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1546 microversion: 2.1 time: 0.173677 Jul 28 06:44:21.653816 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 507/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:21 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:21.681655 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-66d06123-256e-4da1-8df7-e8f4cc551c98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:21.682248 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-66d06123-256e-4da1-8df7-e8f4cc551c98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:21.722922 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-66d06123-256e-4da1-8df7-e8f4cc551c98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:21.727165 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-66d06123-256e-4da1-8df7-e8f4cc551c98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:21.727165 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-66d06123-256e-4da1-8df7-e8f4cc551c98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:21.727165 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-66d06123-256e-4da1-8df7-e8f4cc551c98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:21.813230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-66d06123-256e-4da1-8df7-e8f4cc551c98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137857 Jul 28 06:44:21.813843 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 506/1013] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Jul 28 06:44:21 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:44:22.431063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d10dc3e0-5396-44ef-8359-11e613029409 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:22.434192 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d10dc3e0-5396-44ef-8359-11e613029409 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:22.459144 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d10dc3e0-5396-44ef-8359-11e613029409 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:22.459746 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d10dc3e0-5396-44ef-8359-11e613029409 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:22.461176 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d10dc3e0-5396-44ef-8359-11e613029409 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:22.461176 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d10dc3e0-5396-44ef-8359-11e613029409 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:22.710174 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d10dc3e0-5396-44ef-8359-11e613029409 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:22.728999 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d10dc3e0-5396-44ef-8359-11e613029409 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:22.730497 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d10dc3e0-5396-44ef-8359-11e613029409 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:22.731665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d10dc3e0-5396-44ef-8359-11e613029409 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1738 microversion: 2.20 time: 0.305283 Jul 28 06:44:22.732582 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 508/1014] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:22 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:23.240259 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-ff3d0462-8ea0-4fb1-b626-35a9a72ec32f req-4c214d93-7b70-4af3-b4df-065fa96d96b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a696f5-5e72-43ab-ab80-76c7ff3a3266", "tag": "310d1b9d-3dfc-4fa0-b2aa-ffd999bcd30b"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:23.250312 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-ff3d0462-8ea0-4fb1-b626-35a9a72ec32f req-4c214d93-7b70-4af3-b4df-065fa96d96b4 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:23.250760 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-ff3d0462-8ea0-4fb1-b626-35a9a72ec32f req-4c214d93-7b70-4af3-b4df-065fa96d96b4 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:23.265443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-ff3d0462-8ea0-4fb1-b626-35a9a72ec32f req-4c214d93-7b70-4af3-b4df-065fa96d96b4 service nova] Creating event network-changed:310d1b9d-3dfc-4fa0-b2aa-ffd999bcd30b for instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 on hv-cinder-85060 Jul 28 06:44:23.270765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-ff3d0462-8ea0-4fb1-b626-35a9a72ec32f req-4c214d93-7b70-4af3-b4df-065fa96d96b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035200 Jul 28 06:44:23.271762 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 507/1015] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:44:23.766335 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-50fb7ea7-58fc-470b-b502-ee57639330e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:23.769230 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-50fb7ea7-58fc-470b-b502-ee57639330e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:23.781939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-50fb7ea7-58fc-470b-b502-ee57639330e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:23.783113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-50fb7ea7-58fc-470b-b502-ee57639330e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:23.785340 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-50fb7ea7-58fc-470b-b502-ee57639330e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:23.786425 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-50fb7ea7-58fc-470b-b502-ee57639330e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:24.098359 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-50fb7ea7-58fc-470b-b502-ee57639330e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:24.113142 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-50fb7ea7-58fc-470b-b502-ee57639330e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:24.116681 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-50fb7ea7-58fc-470b-b502-ee57639330e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:24.119175 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-50fb7ea7-58fc-470b-b502-ee57639330e3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1738 microversion: 2.20 time: 0.365717 Jul 28 06:44:24.120521 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 509/1016] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:23 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1738 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:25.147943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-135c1756-75ec-4071-843e-c01b5d4de502 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:25.149472 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-135c1756-75ec-4071-843e-c01b5d4de502 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:25.156709 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-135c1756-75ec-4071-843e-c01b5d4de502 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:25.157167 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-135c1756-75ec-4071-843e-c01b5d4de502 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:25.157978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-135c1756-75ec-4071-843e-c01b5d4de502 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:25.158425 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-135c1756-75ec-4071-843e-c01b5d4de502 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:25.298299 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-135c1756-75ec-4071-843e-c01b5d4de502 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:25.308762 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-135c1756-75ec-4071-843e-c01b5d4de502 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:25.310727 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-135c1756-75ec-4071-843e-c01b5d4de502 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:25.311933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-135c1756-75ec-4071-843e-c01b5d4de502 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1738 microversion: 2.20 time: 0.168262 Jul 28 06:44:25.312611 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 508/1017] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:25 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:26.335440 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-77999b57-1844-4ea0-bc1e-ba8b74a735ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:26.336867 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-77999b57-1844-4ea0-bc1e-ba8b74a735ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:26.343421 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77999b57-1844-4ea0-bc1e-ba8b74a735ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:26.343870 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77999b57-1844-4ea0-bc1e-ba8b74a735ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:26.344634 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77999b57-1844-4ea0-bc1e-ba8b74a735ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:26.345066 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77999b57-1844-4ea0-bc1e-ba8b74a735ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:26.549719 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-77999b57-1844-4ea0-bc1e-ba8b74a735ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:26.558073 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-77999b57-1844-4ea0-bc1e-ba8b74a735ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:26.559593 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-77999b57-1844-4ea0-bc1e-ba8b74a735ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:26.560753 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-77999b57-1844-4ea0-bc1e-ba8b74a735ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1720 microversion: 2.20 time: 0.229196 Jul 28 06:44:26.561330 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 510/1018] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:26 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:27.586953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a0da4a3b-b2f8-41fc-87b2-40dd72e52ed0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:27.587565 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a0da4a3b-b2f8-41fc-87b2-40dd72e52ed0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:27.594294 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0da4a3b-b2f8-41fc-87b2-40dd72e52ed0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:27.594741 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0da4a3b-b2f8-41fc-87b2-40dd72e52ed0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:27.595535 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0da4a3b-b2f8-41fc-87b2-40dd72e52ed0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:27.595965 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a0da4a3b-b2f8-41fc-87b2-40dd72e52ed0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:27.744865 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a0da4a3b-b2f8-41fc-87b2-40dd72e52ed0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:27.753537 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a0da4a3b-b2f8-41fc-87b2-40dd72e52ed0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:27.755053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-a0da4a3b-b2f8-41fc-87b2-40dd72e52ed0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:27.756213 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a0da4a3b-b2f8-41fc-87b2-40dd72e52ed0 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1720 microversion: 2.20 time: 0.173851 Jul 28 06:44:27.756773 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 509/1019] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:27 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:28.779351 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-08cb297e-9ed2-4409-8f5c-38080e888006 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:28.779951 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-08cb297e-9ed2-4409-8f5c-38080e888006 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:28.786599 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-08cb297e-9ed2-4409-8f5c-38080e888006 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:28.787043 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-08cb297e-9ed2-4409-8f5c-38080e888006 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:28.787808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-08cb297e-9ed2-4409-8f5c-38080e888006 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:28.788237 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-08cb297e-9ed2-4409-8f5c-38080e888006 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:28.850427 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-5f2a1e4b-ea09-44e8-b8b1-5e118091cee5 req-b78fbda3-e124-4253-86c0-d58d638d54a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163a335a-d407-4ec6-9c94-f0d8e37e83d4", "name": "network-vif-unplugged", "status": "completed", "tag": "dc86c76c-8061-4d08-8a5f-ec9bba7801ad"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:28.862384 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-5f2a1e4b-ea09-44e8-b8b1-5e118091cee5 req-b78fbda3-e124-4253-86c0-d58d638d54a2 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:28.863147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-5f2a1e4b-ea09-44e8-b8b1-5e118091cee5 req-b78fbda3-e124-4253-86c0-d58d638d54a2 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:28.877277 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-5f2a1e4b-ea09-44e8-b8b1-5e118091cee5 req-b78fbda3-e124-4253-86c0-d58d638d54a2 service nova] Creating event network-vif-unplugged:dc86c76c-8061-4d08-8a5f-ec9bba7801ad for instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 on hv-cinder-85060 Jul 28 06:44:28.882982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-5f2a1e4b-ea09-44e8-b8b1-5e118091cee5 req-b78fbda3-e124-4253-86c0-d58d638d54a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036922 Jul 28 06:44:28.883882 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 510/1020] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:44:28.930799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-08cb297e-9ed2-4409-8f5c-38080e888006 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:28.939244 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-08cb297e-9ed2-4409-8f5c-38080e888006 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:28.940774 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-08cb297e-9ed2-4409-8f5c-38080e888006 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:28.942610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-08cb297e-9ed2-4409-8f5c-38080e888006 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1723 microversion: 2.20 time: 0.166844 Jul 28 06:44:28.943168 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 511/1021] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:28 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:28.965724 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-55ade053-df67-424b-a569-a31a44f93497 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17f30aac-9bc4-4ba2-b784-c3269cd3a6bd"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:28.968136 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-55ade053-df67-424b-a569-a31a44f93497 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:28.974462 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-55ade053-df67-424b-a569-a31a44f93497 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:28.974907 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-55ade053-df67-424b-a569-a31a44f93497 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:28.975662 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-55ade053-df67-424b-a569-a31a44f93497 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:28.976639 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-55ade053-df67-424b-a569-a31a44f93497 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:29.252812 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-55ade053-df67-424b-a569-a31a44f93497 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "POST /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291636 Jul 28 06:44:29.253472 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 511/1022] 10.222.0.20 () {62 vars in 1364 bytes} [Thu Jul 28 06:44:28 2022] POST /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:44:29.375791 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-12867a48-ad35-4bf8-b9cb-059c7587d607 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:29.376288 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-12867a48-ad35-4bf8-b9cb-059c7587d607 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:29.382337 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-12867a48-ad35-4bf8-b9cb-059c7587d607 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:29.382788 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-12867a48-ad35-4bf8-b9cb-059c7587d607 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:29.383589 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-12867a48-ad35-4bf8-b9cb-059c7587d607 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:29.384026 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-12867a48-ad35-4bf8-b9cb-059c7587d607 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:29.644283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-12867a48-ad35-4bf8-b9cb-059c7587d607 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/os-volume_attachments/17f30aac-9bc4-4ba2-b784-c3269cd3a6bd" status: 202 len: 0 microversion: 2.20 time: 0.272311 Jul 28 06:44:29.644869 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 512/1023] 10.222.0.20 () {60 vars in 1457 bytes} [Thu Jul 28 06:44:29 2022] DELETE /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/os-volume_attachments/17f30aac-9bc4-4ba2-b784-c3269cd3a6bd => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:44:29.707440 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d6f165da-de05-41e8-8721-6b4ac6fa59e2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:29.708028 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d6f165da-de05-41e8-8721-6b4ac6fa59e2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:29.715137 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d6f165da-de05-41e8-8721-6b4ac6fa59e2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:29.715582 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d6f165da-de05-41e8-8721-6b4ac6fa59e2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:29.716355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d6f165da-de05-41e8-8721-6b4ac6fa59e2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:29.716788 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d6f165da-de05-41e8-8721-6b4ac6fa59e2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:29.746828 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d6f165da-de05-41e8-8721-6b4ac6fa59e2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124563) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 06:44:29.811594 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d6f165da-de05-41e8-8721-6b4ac6fa59e2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "POST /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/action" status: 202 len: 0 microversion: 2.20 time: 0.108273 Jul 28 06:44:29.812098 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 512/1024] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Jul 28 06:44:29 2022] POST /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:44:29.820341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2e7ef6a7-53f1-4297-a618-21cf789dfad7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:29.820950 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2e7ef6a7-53f1-4297-a618-21cf789dfad7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:29.828622 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e7ef6a7-53f1-4297-a618-21cf789dfad7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:29.829079 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e7ef6a7-53f1-4297-a618-21cf789dfad7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:29.829851 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e7ef6a7-53f1-4297-a618-21cf789dfad7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:29.830287 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2e7ef6a7-53f1-4297-a618-21cf789dfad7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:29.963545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2e7ef6a7-53f1-4297-a618-21cf789dfad7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:29.979635 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2e7ef6a7-53f1-4297-a618-21cf789dfad7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:29.982602 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2e7ef6a7-53f1-4297-a618-21cf789dfad7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:29.984179 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2e7ef6a7-53f1-4297-a618-21cf789dfad7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1671 microversion: 2.20 time: 0.167822 Jul 28 06:44:29.984987 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 513/1025] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:29 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:31.007668 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d2b961e5-15f8-42b3-be27-f15e93eb9814 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:31.008277 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d2b961e5-15f8-42b3-be27-f15e93eb9814 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:31.016099 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2b961e5-15f8-42b3-be27-f15e93eb9814 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:31.016776 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2b961e5-15f8-42b3-be27-f15e93eb9814 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:31.017968 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2b961e5-15f8-42b3-be27-f15e93eb9814 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:31.018630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d2b961e5-15f8-42b3-be27-f15e93eb9814 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:31.160250 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d2b961e5-15f8-42b3-be27-f15e93eb9814 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:31.168679 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d2b961e5-15f8-42b3-be27-f15e93eb9814 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:31.170217 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d2b961e5-15f8-42b3-be27-f15e93eb9814 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:31.171376 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d2b961e5-15f8-42b3-be27-f15e93eb9814 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.168205 Jul 28 06:44:31.171927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 513/1026] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:31 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:32.195475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0958f23d-36e0-4862-9eaf-d09466b5e985 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:32.196158 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0958f23d-36e0-4862-9eaf-d09466b5e985 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:32.202611 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0958f23d-36e0-4862-9eaf-d09466b5e985 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:32.203087 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0958f23d-36e0-4862-9eaf-d09466b5e985 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:32.203853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0958f23d-36e0-4862-9eaf-d09466b5e985 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:32.204290 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0958f23d-36e0-4862-9eaf-d09466b5e985 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:32.350357 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0958f23d-36e0-4862-9eaf-d09466b5e985 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:32.359989 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0958f23d-36e0-4862-9eaf-d09466b5e985 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:32.361655 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0958f23d-36e0-4862-9eaf-d09466b5e985 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:32.363164 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0958f23d-36e0-4862-9eaf-d09466b5e985 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.171713 Jul 28 06:44:32.363931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 514/1027] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:32 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:33.390811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4b240f09-b3d1-4dc1-b311-ba8b6c371183 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:33.391430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4b240f09-b3d1-4dc1-b311-ba8b6c371183 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:33.398355 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4b240f09-b3d1-4dc1-b311-ba8b6c371183 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:33.398845 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4b240f09-b3d1-4dc1-b311-ba8b6c371183 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:33.399627 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4b240f09-b3d1-4dc1-b311-ba8b6c371183 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:33.400069 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4b240f09-b3d1-4dc1-b311-ba8b6c371183 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:33.543231 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4b240f09-b3d1-4dc1-b311-ba8b6c371183 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:33.551776 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4b240f09-b3d1-4dc1-b311-ba8b6c371183 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:33.553277 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4b240f09-b3d1-4dc1-b311-ba8b6c371183 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:33.554481 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4b240f09-b3d1-4dc1-b311-ba8b6c371183 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.167624 Jul 28 06:44:33.555035 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 514/1028] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:33 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:34.578451 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-84f120bb-2677-4f89-b497-93710dd83b97 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:34.579779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-84f120bb-2677-4f89-b497-93710dd83b97 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:34.582138 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:34.587366 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84f120bb-2677-4f89-b497-93710dd83b97 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:34.587885 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84f120bb-2677-4f89-b497-93710dd83b97 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:34.588611 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84f120bb-2677-4f89-b497-93710dd83b97 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:34.589244 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84f120bb-2677-4f89-b497-93710dd83b97 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:34.728398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-84f120bb-2677-4f89-b497-93710dd83b97 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:34.737681 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-84f120bb-2677-4f89-b497-93710dd83b97 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:34.739184 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-84f120bb-2677-4f89-b497-93710dd83b97 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:34.740348 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-84f120bb-2677-4f89-b497-93710dd83b97 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.166334 Jul 28 06:44:34.740908 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 515/1029] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:34 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:35.763684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-10de52a6-d7d3-46a3-9f7c-8c9f77c8d0ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:35.764407 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-10de52a6-d7d3-46a3-9f7c-8c9f77c8d0ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:35.771356 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-10de52a6-d7d3-46a3-9f7c-8c9f77c8d0ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:35.771814 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-10de52a6-d7d3-46a3-9f7c-8c9f77c8d0ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:35.772608 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-10de52a6-d7d3-46a3-9f7c-8c9f77c8d0ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:35.773050 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-10de52a6-d7d3-46a3-9f7c-8c9f77c8d0ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:35.916127 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-10de52a6-d7d3-46a3-9f7c-8c9f77c8d0ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:35.925246 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-10de52a6-d7d3-46a3-9f7c-8c9f77c8d0ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:35.926904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-10de52a6-d7d3-46a3-9f7c-8c9f77c8d0ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:35.928184 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-10de52a6-d7d3-46a3-9f7c-8c9f77c8d0ce tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.169026 Jul 28 06:44:35.928907 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 515/1030] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:35 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:36.952852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3207c6af-8f13-4ad4-be3d-63d0293b726c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:36.953475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3207c6af-8f13-4ad4-be3d-63d0293b726c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:36.959781 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3207c6af-8f13-4ad4-be3d-63d0293b726c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:36.960228 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3207c6af-8f13-4ad4-be3d-63d0293b726c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:36.961006 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3207c6af-8f13-4ad4-be3d-63d0293b726c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:36.961471 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3207c6af-8f13-4ad4-be3d-63d0293b726c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:37.105054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3207c6af-8f13-4ad4-be3d-63d0293b726c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:37.114314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3207c6af-8f13-4ad4-be3d-63d0293b726c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:37.115820 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-3207c6af-8f13-4ad4-be3d-63d0293b726c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:37.116983 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3207c6af-8f13-4ad4-be3d-63d0293b726c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.168877 Jul 28 06:44:37.117564 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 516/1031] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:36 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:38.140716 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b55ae9a1-593c-48eb-bbdc-d4811e7ddb88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:38.141992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b55ae9a1-593c-48eb-bbdc-d4811e7ddb88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:38.148697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b55ae9a1-593c-48eb-bbdc-d4811e7ddb88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:38.149153 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b55ae9a1-593c-48eb-bbdc-d4811e7ddb88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:38.149962 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b55ae9a1-593c-48eb-bbdc-d4811e7ddb88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:38.150403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b55ae9a1-593c-48eb-bbdc-d4811e7ddb88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:38.154533 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:38.295535 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b55ae9a1-593c-48eb-bbdc-d4811e7ddb88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:38.303641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b55ae9a1-593c-48eb-bbdc-d4811e7ddb88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:38.305188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b55ae9a1-593c-48eb-bbdc-d4811e7ddb88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:38.306419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b55ae9a1-593c-48eb-bbdc-d4811e7ddb88 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.169745 Jul 28 06:44:38.306975 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 516/1032] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:38 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:39.332245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e99ca756-67ff-4878-9972-6e8cff9a43ed tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:39.332940 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e99ca756-67ff-4878-9972-6e8cff9a43ed tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:39.339812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e99ca756-67ff-4878-9972-6e8cff9a43ed tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:39.340835 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e99ca756-67ff-4878-9972-6e8cff9a43ed tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:39.341758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e99ca756-67ff-4878-9972-6e8cff9a43ed tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:39.342201 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e99ca756-67ff-4878-9972-6e8cff9a43ed tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:39.504099 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e99ca756-67ff-4878-9972-6e8cff9a43ed tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:39.513547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e99ca756-67ff-4878-9972-6e8cff9a43ed tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:39.515305 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e99ca756-67ff-4878-9972-6e8cff9a43ed tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:39.516683 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e99ca756-67ff-4878-9972-6e8cff9a43ed tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.188529 Jul 28 06:44:39.517360 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 517/1033] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:39 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:40.540072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0a08bc75-d642-4d6a-b7d5-51a0c230c6a1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:40.540767 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0a08bc75-d642-4d6a-b7d5-51a0c230c6a1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:40.547871 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a08bc75-d642-4d6a-b7d5-51a0c230c6a1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:40.548324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a08bc75-d642-4d6a-b7d5-51a0c230c6a1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:40.549103 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a08bc75-d642-4d6a-b7d5-51a0c230c6a1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:40.549570 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a08bc75-d642-4d6a-b7d5-51a0c230c6a1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:40.706436 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0a08bc75-d642-4d6a-b7d5-51a0c230c6a1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:40.714569 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0a08bc75-d642-4d6a-b7d5-51a0c230c6a1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:40.716931 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-0a08bc75-d642-4d6a-b7d5-51a0c230c6a1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:40.718152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0a08bc75-d642-4d6a-b7d5-51a0c230c6a1 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.182174 Jul 28 06:44:40.718722 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 517/1034] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:40 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:41.740731 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cac80325-e93d-41e4-955b-343e138539fe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:41.741421 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cac80325-e93d-41e4-955b-343e138539fe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:41.748380 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cac80325-e93d-41e4-955b-343e138539fe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:41.748830 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cac80325-e93d-41e4-955b-343e138539fe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:41.749630 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cac80325-e93d-41e4-955b-343e138539fe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:41.750069 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cac80325-e93d-41e4-955b-343e138539fe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:41.768200 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:41.881409 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cac80325-e93d-41e4-955b-343e138539fe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:41.890604 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cac80325-e93d-41e4-955b-343e138539fe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:41.892107 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cac80325-e93d-41e4-955b-343e138539fe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:41.893284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cac80325-e93d-41e4-955b-343e138539fe tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.156527 Jul 28 06:44:41.893901 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 518/1035] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:41 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:42.915843 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7ffa7142-3400-4a37-a431-da94e7138424 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:42.916475 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7ffa7142-3400-4a37-a431-da94e7138424 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:42.924114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7ffa7142-3400-4a37-a431-da94e7138424 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:42.924563 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7ffa7142-3400-4a37-a431-da94e7138424 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:42.925349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7ffa7142-3400-4a37-a431-da94e7138424 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:42.925789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7ffa7142-3400-4a37-a431-da94e7138424 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:43.054334 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7ffa7142-3400-4a37-a431-da94e7138424 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:43.062876 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7ffa7142-3400-4a37-a431-da94e7138424 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:43.064384 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7ffa7142-3400-4a37-a431-da94e7138424 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:43.065611 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7ffa7142-3400-4a37-a431-da94e7138424 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.153632 Jul 28 06:44:43.066166 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 518/1036] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:42 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:43.388048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-fdcb6816-7ce1-4153-8dd6-2a86caf02127 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:43.388624 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-fdcb6816-7ce1-4153-8dd6-2a86caf02127 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:43.395178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fdcb6816-7ce1-4153-8dd6-2a86caf02127 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:43.395617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fdcb6816-7ce1-4153-8dd6-2a86caf02127 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:43.396378 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fdcb6816-7ce1-4153-8dd6-2a86caf02127 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:43.396806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-fdcb6816-7ce1-4153-8dd6-2a86caf02127 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:43.420309 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-fdcb6816-7ce1-4153-8dd6-2a86caf02127 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/ips" status: 200 len: 148 microversion: 2.1 time: 0.035988 Jul 28 06:44:43.421083 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 519/1037] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Jul 28 06:44:43 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:44:44.088574 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-953862b3-4eb4-4cea-94d9-298a12455eeb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:44.089191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-953862b3-4eb4-4cea-94d9-298a12455eeb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:44.096010 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-953862b3-4eb4-4cea-94d9-298a12455eeb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:44.096463 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-953862b3-4eb4-4cea-94d9-298a12455eeb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:44.097231 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-953862b3-4eb4-4cea-94d9-298a12455eeb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:44.097698 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-953862b3-4eb4-4cea-94d9-298a12455eeb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:44.228802 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-953862b3-4eb4-4cea-94d9-298a12455eeb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:44.236772 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-953862b3-4eb4-4cea-94d9-298a12455eeb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:44.238291 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-953862b3-4eb4-4cea-94d9-298a12455eeb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:44.239427 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-953862b3-4eb4-4cea-94d9-298a12455eeb tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.154862 Jul 28 06:44:44.239974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 519/1038] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:44 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:44.752648 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d73abd8c-fce6-462c-9eaf-f33ca7b473d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2246680-5520-4541-8004-49899a8dc328"}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:44.755089 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d73abd8c-fce6-462c-9eaf-f33ca7b473d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:44.761637 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d73abd8c-fce6-462c-9eaf-f33ca7b473d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:44.762077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d73abd8c-fce6-462c-9eaf-f33ca7b473d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:44.762961 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d73abd8c-fce6-462c-9eaf-f33ca7b473d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:44.763387 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d73abd8c-fce6-462c-9eaf-f33ca7b473d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:45.033708 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d73abd8c-fce6-462c-9eaf-f33ca7b473d2 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "POST /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284790 Jul 28 06:44:45.034489 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 520/1039] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:44:44 2022] POST /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:44:45.263288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-03b3aab9-387d-40c7-9ca7-070e320b0e83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:45.263824 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-03b3aab9-387d-40c7-9ca7-070e320b0e83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:45.270259 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03b3aab9-387d-40c7-9ca7-070e320b0e83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:45.270704 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03b3aab9-387d-40c7-9ca7-070e320b0e83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:45.271457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03b3aab9-387d-40c7-9ca7-070e320b0e83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:45.271889 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03b3aab9-387d-40c7-9ca7-070e320b0e83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:45.406886 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-03b3aab9-387d-40c7-9ca7-070e320b0e83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:45.414845 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-03b3aab9-387d-40c7-9ca7-070e320b0e83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:45.416343 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-03b3aab9-387d-40c7-9ca7-070e320b0e83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:45.417535 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-03b3aab9-387d-40c7-9ca7-070e320b0e83 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.158289 Jul 28 06:44:45.418091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 520/1040] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:45 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:46.443387 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2aed878f-9562-47a7-84e9-3ea99eb7e18c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:46.443997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2aed878f-9562-47a7-84e9-3ea99eb7e18c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:46.450605 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2aed878f-9562-47a7-84e9-3ea99eb7e18c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:46.450861 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2aed878f-9562-47a7-84e9-3ea99eb7e18c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:46.451626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2aed878f-9562-47a7-84e9-3ea99eb7e18c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:46.452060 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2aed878f-9562-47a7-84e9-3ea99eb7e18c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:46.586305 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2aed878f-9562-47a7-84e9-3ea99eb7e18c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:46.594180 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2aed878f-9562-47a7-84e9-3ea99eb7e18c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:46.595669 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2aed878f-9562-47a7-84e9-3ea99eb7e18c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:46.596801 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2aed878f-9562-47a7-84e9-3ea99eb7e18c tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.158511 Jul 28 06:44:46.597364 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 521/1041] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:46 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:44:47.014733 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-d968d6ca-1ec4-4883-8fe1-80817f64f889 req-285c75e3-c2cd-405c-92e0-c24bfe3177aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163a335a-d407-4ec6-9c94-f0d8e37e83d4", "name": "network-vif-plugged", "status": "completed", "tag": "dc86c76c-8061-4d08-8a5f-ec9bba7801ad"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:47.024916 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-d968d6ca-1ec4-4883-8fe1-80817f64f889 req-285c75e3-c2cd-405c-92e0-c24bfe3177aa service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:47.025396 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-d968d6ca-1ec4-4883-8fe1-80817f64f889 req-285c75e3-c2cd-405c-92e0-c24bfe3177aa service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:47.037025 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-d968d6ca-1ec4-4883-8fe1-80817f64f889 req-285c75e3-c2cd-405c-92e0-c24bfe3177aa service nova] Creating event network-vif-plugged:dc86c76c-8061-4d08-8a5f-ec9bba7801ad for instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 on hv-cinder-85060 Jul 28 06:44:47.041982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-d968d6ca-1ec4-4883-8fe1-80817f64f889 req-285c75e3-c2cd-405c-92e0-c24bfe3177aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031024 Jul 28 06:44:47.042559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 521/1042] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:44:47.620183 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-58ac109c-f79d-4f4f-88ab-adccc0473b85 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:47.620802 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-58ac109c-f79d-4f4f-88ab-adccc0473b85 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:47.628070 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-58ac109c-f79d-4f4f-88ab-adccc0473b85 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:47.628525 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-58ac109c-f79d-4f4f-88ab-adccc0473b85 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:47.629314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-58ac109c-f79d-4f4f-88ab-adccc0473b85 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:47.629754 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-58ac109c-f79d-4f4f-88ab-adccc0473b85 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:47.766279 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-58ac109c-f79d-4f4f-88ab-adccc0473b85 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:47.774208 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-58ac109c-f79d-4f4f-88ab-adccc0473b85 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:47.775707 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-58ac109c-f79d-4f4f-88ab-adccc0473b85 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:47.776858 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-58ac109c-f79d-4f4f-88ab-adccc0473b85 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.160789 Jul 28 06:44:47.777437 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 522/1043] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:47 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:48.801680 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-514614b6-4c38-4d43-a1c4-ab5375b2ecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:48.802632 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-514614b6-4c38-4d43-a1c4-ab5375b2ecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:48.808972 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-514614b6-4c38-4d43-a1c4-ab5375b2ecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:48.809537 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-514614b6-4c38-4d43-a1c4-ab5375b2ecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:48.811643 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-514614b6-4c38-4d43-a1c4-ab5375b2ecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:48.812164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-514614b6-4c38-4d43-a1c4-ab5375b2ecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:48.960323 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-514614b6-4c38-4d43-a1c4-ab5375b2ecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:48.968943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-514614b6-4c38-4d43-a1c4-ab5375b2ecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:48.970471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-514614b6-4c38-4d43-a1c4-ab5375b2ecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:48.971663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-514614b6-4c38-4d43-a1c4-ab5375b2ecbf tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1729 microversion: 2.20 time: 0.174785 Jul 28 06:44:48.972217 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 522/1044] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:48 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:49.995610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-049b9b93-7331-4b4a-9246-fc99006819e7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:49.996246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-049b9b93-7331-4b4a-9246-fc99006819e7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:50.003601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-049b9b93-7331-4b4a-9246-fc99006819e7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:50.004052 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-049b9b93-7331-4b4a-9246-fc99006819e7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:50.004816 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-049b9b93-7331-4b4a-9246-fc99006819e7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:50.005262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-049b9b93-7331-4b4a-9246-fc99006819e7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:50.135377 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-049b9b93-7331-4b4a-9246-fc99006819e7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:50.143421 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-049b9b93-7331-4b4a-9246-fc99006819e7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:50.144937 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-049b9b93-7331-4b4a-9246-fc99006819e7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:50.146124 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-049b9b93-7331-4b4a-9246-fc99006819e7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1716 microversion: 2.20 time: 0.154459 Jul 28 06:44:50.146687 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 523/1045] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:44:49 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:44:52.673692 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b9cafb6a-f5b9-42f9-916d-100e30af8b9c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:52.674182 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b9cafb6a-f5b9-42f9-916d-100e30af8b9c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:52.676607 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:44:52.682240 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9cafb6a-f5b9-42f9-916d-100e30af8b9c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:52.682685 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9cafb6a-f5b9-42f9-916d-100e30af8b9c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:52.683443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9cafb6a-f5b9-42f9-916d-100e30af8b9c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:52.683872 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b9cafb6a-f5b9-42f9-916d-100e30af8b9c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:52.764817 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-b9cafb6a-f5b9-42f9-916d-100e30af8b9c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lazy-loading 'services' on Instance uuid d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:44:52.839254 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b9cafb6a-f5b9-42f9-916d-100e30af8b9c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/os-volume_attachments/d2246680-5520-4541-8004-49899a8dc328" status: 202 len: 0 microversion: 2.1 time: 0.169917 Jul 28 06:44:52.839831 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 523/1046] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:44:52 2022] DELETE /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/os-volume_attachments/d2246680-5520-4541-8004-49899a8dc328 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:44:52.848669 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a0343e58-c762-4452-9f78-afb0fa8bcdd0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:52.851036 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a0343e58-c762-4452-9f78-afb0fa8bcdd0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:52.858519 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0343e58-c762-4452-9f78-afb0fa8bcdd0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:52.858976 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0343e58-c762-4452-9f78-afb0fa8bcdd0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:52.859777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0343e58-c762-4452-9f78-afb0fa8bcdd0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:52.860206 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0343e58-c762-4452-9f78-afb0fa8bcdd0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:52.890704 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a0343e58-c762-4452-9f78-afb0fa8bcdd0 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045870 Jul 28 06:44:52.891279 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 524/1047] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:44:52 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:44:53.905720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a38b49fa-2373-4ac3-b9ae-c0ea38b162d9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:53.908097 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a38b49fa-2373-4ac3-b9ae-c0ea38b162d9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:53.914945 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a38b49fa-2373-4ac3-b9ae-c0ea38b162d9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:53.915402 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a38b49fa-2373-4ac3-b9ae-c0ea38b162d9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:53.916177 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a38b49fa-2373-4ac3-b9ae-c0ea38b162d9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:53.916617 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a38b49fa-2373-4ac3-b9ae-c0ea38b162d9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:53.946014 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a38b49fa-2373-4ac3-b9ae-c0ea38b162d9 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046290 Jul 28 06:44:53.946567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 524/1048] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:44:53 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:44:54.007986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3a62a5ad-e435-4c19-bcea-bc2eda32d937 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:54.008489 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3a62a5ad-e435-4c19-bcea-bc2eda32d937 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:54.015529 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3a62a5ad-e435-4c19-bcea-bc2eda32d937 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:54.015957 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3a62a5ad-e435-4c19-bcea-bc2eda32d937 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:54.016722 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3a62a5ad-e435-4c19-bcea-bc2eda32d937 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:54.017158 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3a62a5ad-e435-4c19-bcea-bc2eda32d937 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:54.042896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3a62a5ad-e435-4c19-bcea-bc2eda32d937 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:44:54.117212 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3a62a5ad-e435-4c19-bcea-bc2eda32d937 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 204 len: 0 microversion: 2.1 time: 0.112669 Jul 28 06:44:54.117932 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 525/1049] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:44:54 2022] DELETE /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:44:54.126927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ea781169-ca6e-4799-ae05-87cf948fd863 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:54.127542 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ea781169-ca6e-4799-ae05-87cf948fd863 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:54.133881 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ea781169-ca6e-4799-ae05-87cf948fd863 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:54.134338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ea781169-ca6e-4799-ae05-87cf948fd863 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:54.135107 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ea781169-ca6e-4799-ae05-87cf948fd863 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:54.135551 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ea781169-ca6e-4799-ae05-87cf948fd863 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:54.267304 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ea781169-ca6e-4799-ae05-87cf948fd863 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:54.274807 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ea781169-ca6e-4799-ae05-87cf948fd863 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1680 microversion: 2.1 time: 0.152193 Jul 28 06:44:54.275377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 525/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:54 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:55.297202 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6d2ea7a0-d678-4284-8781-33bd87d8be07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:55.297925 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6d2ea7a0-d678-4284-8781-33bd87d8be07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:55.305231 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d2ea7a0-d678-4284-8781-33bd87d8be07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:55.305718 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d2ea7a0-d678-4284-8781-33bd87d8be07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:55.306483 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d2ea7a0-d678-4284-8781-33bd87d8be07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:55.306913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6d2ea7a0-d678-4284-8781-33bd87d8be07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:55.451591 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6d2ea7a0-d678-4284-8781-33bd87d8be07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:55.462995 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6d2ea7a0-d678-4284-8781-33bd87d8be07 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1680 microversion: 2.1 time: 0.170486 Jul 28 06:44:55.463561 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 526/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:55 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:56.484741 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d9a48150-cbb9-4fda-94dc-e7ba27a7d0fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:56.485386 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d9a48150-cbb9-4fda-94dc-e7ba27a7d0fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:56.492156 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9a48150-cbb9-4fda-94dc-e7ba27a7d0fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:56.492601 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9a48150-cbb9-4fda-94dc-e7ba27a7d0fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:56.493392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9a48150-cbb9-4fda-94dc-e7ba27a7d0fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:56.493827 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d9a48150-cbb9-4fda-94dc-e7ba27a7d0fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:56.636443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d9a48150-cbb9-4fda-94dc-e7ba27a7d0fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:56.644673 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d9a48150-cbb9-4fda-94dc-e7ba27a7d0fe tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1680 microversion: 2.1 time: 0.164533 Jul 28 06:44:56.645249 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 526/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:56 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:57.134630 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-8f6e9fc9-2218-4f29-a2e6-72b83f19cfdd req-146318f1-4692-42ac-b090-376ae9dfec74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d535ac71-ff1d-4f41-95b0-6c780e3b0ed1", "name": "network-vif-deleted", "tag": "3085368c-234d-4061-8c70-32b4923f475e"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:44:57.145854 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-8f6e9fc9-2218-4f29-a2e6-72b83f19cfdd req-146318f1-4692-42ac-b090-376ae9dfec74 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:57.146298 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-8f6e9fc9-2218-4f29-a2e6-72b83f19cfdd req-146318f1-4692-42ac-b090-376ae9dfec74 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:57.157679 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-8f6e9fc9-2218-4f29-a2e6-72b83f19cfdd req-146318f1-4692-42ac-b090-376ae9dfec74 service nova] Creating event network-vif-deleted:3085368c-234d-4061-8c70-32b4923f475e for instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 on hv-cinder-85060 Jul 28 06:44:57.163149 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-8f6e9fc9-2218-4f29-a2e6-72b83f19cfdd req-146318f1-4692-42ac-b090-376ae9dfec74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032029 Jul 28 06:44:57.163739 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 527/1053] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:44:57.666124 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:57.667454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:57.675340 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:57.675843 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:57.676616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:57.677245 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:57.719671 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:57.720411 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:57.721080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lazy-loading 'fault' on Instance uuid d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:44:57.767940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1db92e28444854b9de817dd36104ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcffc8bbe6ec425997d67634a0f7d724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:44:57.776313 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-cd7b3038-c944-4bf2-b937-4a81f51908c4 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 200 len: 1331 microversion: 2.1 time: 0.114096 Jul 28 06:44:57.776894 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 527/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:57 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:44:58.798866 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-632b157a-563f-4009-a116-3ebad124d496 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:58.799571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-632b157a-563f-4009-a116-3ebad124d496 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:44:58.805870 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-632b157a-563f-4009-a116-3ebad124d496 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:58.806351 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-632b157a-563f-4009-a116-3ebad124d496 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:58.807116 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-632b157a-563f-4009-a116-3ebad124d496 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:44:58.807551 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-632b157a-563f-4009-a116-3ebad124d496 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:44:58.821542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-632b157a-563f-4009-a116-3ebad124d496 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-632b157a-563f-4009-a116-3ebad124d496 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 HTTP/1.1 Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:44:58.823141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:44:58.824806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': 'd535ac71-ff1d-4f41-95b0-6c780e3b0ed1'} Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:44:58.826449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:44:58.827997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:44:58.829391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-632b157a-563f-4009-a116-3ebad124d496 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:44:58.829391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-632b157a-563f-4009-a116-3ebad124d496 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 404 len: 111 microversion: 2.1 time: 0.030480 Jul 28 06:44:58.829391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 528/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:44:58 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:44:58.834210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a5d06451-de47-467a-a464-b00234a4c07c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '.version_select at 0x7f57477eeb80>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:44:58.854338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a5d06451-de47-467a-a464-b00234a4c07c tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116091931" status: 202 len: 0 microversion: 2.1 time: 0.023968 Jul 28 06:44:58.855104 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 528/1056] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Jul 28 06:44:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116091931 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:45:00.609405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b436112a-3d2f-4f1f-a9ed-334618a1a77b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:00.609900 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b436112a-3d2f-4f1f-a9ed-334618a1a77b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:00.616321 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b436112a-3d2f-4f1f-a9ed-334618a1a77b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:00.616759 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b436112a-3d2f-4f1f-a9ed-334618a1a77b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:00.617543 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b436112a-3d2f-4f1f-a9ed-334618a1a77b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:00.617973 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b436112a-3d2f-4f1f-a9ed-334618a1a77b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:00.634238 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-b436112a-3d2f-4f1f-a9ed-334618a1a77b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b436112a-3d2f-4f1f-a9ed-334618a1a77b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 HTTP/1.1 Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:45:00.635745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:45:00.637462 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': 'd535ac71-ff1d-4f41-95b0-6c780e3b0ed1'} Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:00.638577 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:45:00.640154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:00.641999 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b436112a-3d2f-4f1f-a9ed-334618a1a77b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:00.641999 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b436112a-3d2f-4f1f-a9ed-334618a1a77b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 404 len: 111 microversion: 2.1 time: 0.032035 Jul 28 06:45:00.641999 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 529/1057] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:45:00 2022] DELETE /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:45:00.645462 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3223607b-be71-4161-91eb-192ab5483155 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:00.646082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3223607b-be71-4161-91eb-192ab5483155 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: d535ac71-ff1d-4f41-95b0-6c780e3b0ed1] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:00.653154 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3223607b-be71-4161-91eb-192ab5483155 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:00.653695 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3223607b-be71-4161-91eb-192ab5483155 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:00.654674 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3223607b-be71-4161-91eb-192ab5483155 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:00.655114 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3223607b-be71-4161-91eb-192ab5483155 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:00.668038 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-3223607b-be71-4161-91eb-192ab5483155 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3223607b-be71-4161-91eb-192ab5483155 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 HTTP/1.1 Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:45:00.670353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:45:00.671944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': 'd535ac71-ff1d-4f41-95b0-6c780e3b0ed1'} Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:00.672856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. Jul 28 06:45:00.674287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:00.675524 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3223607b-be71-4161-91eb-192ab5483155 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:00.675524 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3223607b-be71-4161-91eb-192ab5483155 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1" status: 404 len: 111 microversion: 2.1 time: 0.030123 Jul 28 06:45:00.675524 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 529/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:00 2022] GET /compute/v2.1/servers/d535ac71-ff1d-4f41-95b0-6c780e3b0ed1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:45:01.814208 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-84611a54-d718-4b3b-a76c-8d2e7c8c109b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:01.814704 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-84611a54-d718-4b3b-a76c-8d2e7c8c109b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:01.821367 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84611a54-d718-4b3b-a76c-8d2e7c8c109b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:01.821836 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84611a54-d718-4b3b-a76c-8d2e7c8c109b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:01.822589 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84611a54-d718-4b3b-a76c-8d2e7c8c109b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:01.823018 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84611a54-d718-4b3b-a76c-8d2e7c8c109b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:01.836982 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-84611a54-d718-4b3b-a76c-8d2e7c8c109b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-84611a54-d718-4b3b-a76c-8d2e7c8c109b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 HTTP/1.1 Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:45:01.838562 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:45:01.840131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '61ad6f45-a229-47fe-b992-d41f16bbaf72'} Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:01.841800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:45:01.843410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.844869 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-84611a54-d718-4b3b-a76c-8d2e7c8c109b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:01.844869 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-84611a54-d718-4b3b-a76c-8d2e7c8c109b tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 404 len: 111 microversion: 2.1 time: 0.030298 Jul 28 06:45:01.844869 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 530/1059] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:45:01 2022] DELETE /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:45:01.848405 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b4647e1b-ea25-4274-b2a8-4ff8e32897db tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:01.849028 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b4647e1b-ea25-4274-b2a8-4ff8e32897db tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 61ad6f45-a229-47fe-b992-d41f16bbaf72] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:01.855586 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b4647e1b-ea25-4274-b2a8-4ff8e32897db tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:01.856041 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b4647e1b-ea25-4274-b2a8-4ff8e32897db tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:01.857538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b4647e1b-ea25-4274-b2a8-4ff8e32897db tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:01.857882 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b4647e1b-ea25-4274-b2a8-4ff8e32897db tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:01.870847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-b4647e1b-ea25-4274-b2a8-4ff8e32897db tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b4647e1b-ea25-4274-b2a8-4ff8e32897db tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 HTTP/1.1 Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:45:01.872974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:45:01.875963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '61ad6f45-a229-47fe-b992-d41f16bbaf72'} Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:01.876960 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. Jul 28 06:45:01.878466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.879759 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b4647e1b-ea25-4274-b2a8-4ff8e32897db tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance 61ad6f45-a229-47fe-b992-d41f16bbaf72 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:01.879759 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b4647e1b-ea25-4274-b2a8-4ff8e32897db tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72" status: 404 len: 111 microversion: 2.1 time: 0.030206 Jul 28 06:45:01.879759 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 530/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:01 2022] GET /compute/v2.1/servers/61ad6f45-a229-47fe-b992-d41f16bbaf72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:45:01.884898 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-93908213-7c55-4075-ba92-d35d0aa9a962 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:01.885416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-93908213-7c55-4075-ba92-d35d0aa9a962 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:01.891932 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-93908213-7c55-4075-ba92-d35d0aa9a962 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:01.892381 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-93908213-7c55-4075-ba92-d35d0aa9a962 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:01.893154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-93908213-7c55-4075-ba92-d35d0aa9a962 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:01.893670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-93908213-7c55-4075-ba92-d35d0aa9a962 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:01.907396 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-93908213-7c55-4075-ba92-d35d0aa9a962 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-93908213-7c55-4075-ba92-d35d0aa9a962 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 HTTP/1.1 Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:45:01.908946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:45:01.910777 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': 'b7df248c-2b87-417e-b113-ecce4d8c0840'} Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:01.912019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:45:01.913563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.915402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-93908213-7c55-4075-ba92-d35d0aa9a962 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:01.915402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-93908213-7c55-4075-ba92-d35d0aa9a962 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 404 len: 111 microversion: 2.1 time: 0.029275 Jul 28 06:45:01.915402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 531/1061] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:45:01 2022] DELETE /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:45:01.922565 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4ab339f7-12f3-4fbb-8a8a-ab125323c062 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:01.923192 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4ab339f7-12f3-4fbb-8a8a-ab125323c062 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: b7df248c-2b87-417e-b113-ecce4d8c0840] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:01.929360 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4ab339f7-12f3-4fbb-8a8a-ab125323c062 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:01.929814 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4ab339f7-12f3-4fbb-8a8a-ab125323c062 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:01.930589 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4ab339f7-12f3-4fbb-8a8a-ab125323c062 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:01.931030 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4ab339f7-12f3-4fbb-8a8a-ab125323c062 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:01.946811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-4ab339f7-12f3-4fbb-8a8a-ab125323c062 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4ab339f7-12f3-4fbb-8a8a-ab125323c062 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 HTTP/1.1 Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:45:01.948345 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:45:01.949981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': 'b7df248c-2b87-417e-b113-ecce4d8c0840'} Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:01.950949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. Jul 28 06:45:01.952445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:01.953835 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4ab339f7-12f3-4fbb-8a8a-ab125323c062 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance b7df248c-2b87-417e-b113-ecce4d8c0840 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:01.953835 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4ab339f7-12f3-4fbb-8a8a-ab125323c062 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840" status: 404 len: 111 microversion: 2.1 time: 0.034121 Jul 28 06:45:01.953835 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 531/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:01 2022] GET /compute/v2.1/servers/b7df248c-2b87-417e-b113-ecce4d8c0840 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:45:03.091268 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ec2e501b-c88c-4350-a070-c59f141d411e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:03.091767 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ec2e501b-c88c-4350-a070-c59f141d411e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:03.098159 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ec2e501b-c88c-4350-a070-c59f141d411e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:03.098602 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ec2e501b-c88c-4350-a070-c59f141d411e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:03.099357 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ec2e501b-c88c-4350-a070-c59f141d411e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:03.099786 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ec2e501b-c88c-4350-a070-c59f141d411e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:03.114209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-ec2e501b-c88c-4350-a070-c59f141d411e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ec2e501b-c88c-4350-a070-c59f141d411e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 HTTP/1.1 Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:45:03.115828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:45:03.117472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3'} Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:03.118292 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:45:03.119585 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:03.121090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ec2e501b-c88c-4350-a070-c59f141d411e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:03.121090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ec2e501b-c88c-4350-a070-c59f141d411e tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 404 len: 111 microversion: 2.1 time: 0.030589 Jul 28 06:45:03.121090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 532/1063] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:45:03 2022] DELETE /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:45:03.126107 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-92fd6b9a-c732-48b3-90cf-95b8f30e3407 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:03.126725 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-92fd6b9a-c732-48b3-90cf-95b8f30e3407 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] [instance: 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:03.133310 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-92fd6b9a-c732-48b3-90cf-95b8f30e3407 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:03.133777 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-92fd6b9a-c732-48b3-90cf-95b8f30e3407 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:03.134547 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-92fd6b9a-c732-48b3-90cf-95b8f30e3407 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:03.134989 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-92fd6b9a-c732-48b3-90cf-95b8f30e3407 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:03.149196 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-92fd6b9a-c732-48b3-90cf-95b8f30e3407 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] HTTP exception thrown: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-92fd6b9a-c732-48b3-90cf-95b8f30e3407 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Request method failure captured: Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 HTTP/1.1 Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6mt2JbDF1UaL3TgGebiq5D3Meyh0ck2vxRqigQYfQX4srnm6g7ovzsw9FkOZdiSBHo3AxtIdVG3PoVyJoghxlUws_wNxgfmtIZHvsoVTOUjKWcm208ZUy7ej-kv5AX9i4Opqpzny5D0qc5hvc_5NGHKh5a7dl1lwjZ6bQj_wt7KqQ Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:45:03.150765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcffc8bbe6ec425997d67634a0f7d724", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcffc8bbe6ec425997d67634a0f7d724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcffc8bbe6ec425997d67634a0f7d724"}]}] Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: dcffc8bbe6ec425997d67634a0f7d724 Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776145351 Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 4a1db92e28444854b9de817dd36104ea Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeNegativeTest-1776145351-project Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:45:03.152342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3'} Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:03.153403 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. Jul 28 06:45:03.154791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:03.156173 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-92fd6b9a-c732-48b3-90cf-95b8f30e3407 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] Returning 404 to user: Instance 48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:03.156173 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-92fd6b9a-c732-48b3-90cf-95b8f30e3407 tempest-AttachVolumeNegativeTest-1776145351 tempest-AttachVolumeNegativeTest-1776145351-project] 10.222.0.20 "GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3" status: 404 len: 111 microversion: 2.1 time: 0.030350 Jul 28 06:45:03.156173 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 532/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:03 2022] GET /compute/v2.1/servers/48f9e0c1-cd63-4350-a754-ec4a8a7ef4f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:45:07.177047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-661d3bee-4ad4-4c25-94fd-e5371fb4b6e3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:07.177581 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-661d3bee-4ad4-4c25-94fd-e5371fb4b6e3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:07.179779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:07.186576 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-661d3bee-4ad4-4c25-94fd-e5371fb4b6e3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:07.187177 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-661d3bee-4ad4-4c25-94fd-e5371fb4b6e3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:07.188020 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-661d3bee-4ad4-4c25-94fd-e5371fb4b6e3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:07.188525 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-661d3bee-4ad4-4c25-94fd-e5371fb4b6e3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:07.213438 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-661d3bee-4ad4-4c25-94fd-e5371fb4b6e3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/ips" status: 200 len: 146 microversion: 2.1 time: 0.041367 Jul 28 06:45:07.214007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 533/1065] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Jul 28 06:45:07 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:45:07.683667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d1f3b1b3-1a3f-45bd-a769-aa3c03d3e873 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] Action: 'create', calling method: .version_select at 0x7f574c1ed3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2078861196", "metadata": {"Type": "work"}}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:08.014652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d1f3b1b3-1a3f-45bd-a769-aa3c03d3e873 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.506943 Jul 28 06:45:08.015277 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 533/1066] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Jul 28 06:45:07 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 508 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 06:45:08.027392 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e92ddb9b-f17a-43dc-b6b7-9bc643d26c3a tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] Calling method '.version_select at 0x7f574772ed30>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:08.078554 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e92ddb9b-f17a-43dc-b6b7-9bc643d26c3a tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88" status: 200 len: 353 microversion: 2.1 time: 0.054969 Jul 28 06:45:08.079246 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 534/1067] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:45:08 2022] GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:45:09.093720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-20e15ef9-895a-4505-932d-fcd9c783cebe tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] Calling method '.version_select at 0x7f574c077160>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:09.141683 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-20e15ef9-895a-4505-932d-fcd9c783cebe tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88" status: 200 len: 354 microversion: 2.1 time: 0.052305 Jul 28 06:45:09.142238 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 534/1068] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:45:09 2022] GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:45:09.155048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e5b25dbc-73e1-494a-afeb-7987a537e300 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] Calling method '.version_select at 0x7f5747780310>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:09.202475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e5b25dbc-73e1-494a-afeb-7987a537e300 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88" status: 200 len: 354 microversion: 2.1 time: 0.051833 Jul 28 06:45:09.203045 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 535/1069] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:45:09 2022] GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:45:09.215808 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-827c2d72-2957-44e6-b9fe-0b06fe2f867f tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] Calling method '.version_select at 0x7f574c1ed430>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:09.276360 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-827c2d72-2957-44e6-b9fe-0b06fe2f867f tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88" status: 202 len: 0 microversion: 2.1 time: 0.064373 Jul 28 06:45:09.276925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 535/1070] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Jul 28 06:45:09 2022] DELETE /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:45:09.285752 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-389dfdd2-abb6-4e65-a706-2817d9b05e02 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] Calling method '.version_select at 0x7f574756b040>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:09.335726 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-389dfdd2-abb6-4e65-a706-2817d9b05e02 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88" status: 200 len: 353 microversion: 2.1 time: 0.054523 Jul 28 06:45:09.336287 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 536/1071] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:45:09 2022] GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:45:09.514667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-26c29c4c-0242-4834-8cdd-e2a10a285884 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b735b03-a954-4ec0-a7e5-d91522779a78"}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:09.516988 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-26c29c4c-0242-4834-8cdd-e2a10a285884 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:09.523157 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26c29c4c-0242-4834-8cdd-e2a10a285884 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:09.523609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26c29c4c-0242-4834-8cdd-e2a10a285884 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:09.524373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26c29c4c-0242-4834-8cdd-e2a10a285884 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:09.524811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26c29c4c-0242-4834-8cdd-e2a10a285884 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:09.528962 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:09.799284 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-26c29c4c-0242-4834-8cdd-e2a10a285884 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288774 Jul 28 06:45:09.804111 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 536/1072] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:45:09 2022] POST /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:45:10.350720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ecb2677a-54bc-4622-8acc-3c46e8c14c05 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] Calling method '.version_select at 0x7f574756b430>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:10.378556 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-ecb2677a-54bc-4622-8acc-3c46e8c14c05 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] HTTP exception thrown: Volume fbd240c2-5898-43d6-bc2f-a2ac79575b88 could not be found. Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ecb2677a-54bc-4622-8acc-3c46e8c14c05 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] Request method failure captured: Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88 HTTP/1.1 Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4jBzllCeXrSHXdoIJzTJEh2qeqpCJ_c84Ao9uCMMQqwXNCtGQCcnnOzBBK3iQTMz5e1fV0cK6UFq1iLRRlZAWSYFx1ktepBzlsfkv12kqqtVI8MHITvGuBM5M6HJLN10JYkO7gqFlIL6_bLg19OZ8oQv2JxF9D9EkRh5wocUy-7CoL8 Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: 68344b41c4664159ad624e92e422d892 Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-VolumesGetTestJSON-599622231 Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:45:10.380856 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68344b41c4664159ad624e92e422d892", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68344b41c4664159ad624e92e422d892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68344b41c4664159ad624e92e422d892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68344b41c4664159ad624e92e422d892"}]}] Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-VolumesGetTestJSON-599622231 Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: 68344b41c4664159ad624e92e422d892 Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-VolumesGetTestJSON-599622231 Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-VolumesGetTestJSON-599622231-project Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 1cb6ce5989c843bd9cc8f9a45c87ae66 Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-VolumesGetTestJSON-599622231-project Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Volume fbd240c2-5898-43d6-bc2f-a2ac79575b88 could not be found. Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': 'fbd240c2-5898-43d6-bc2f-a2ac79575b88'} Jul 28 06:45:10.382698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbd240c2-5898-43d6-bc2f-a2ac79575b88 could not be found. (HTTP 404) (Request-ID: req-1e54fef0-7243-4e76-a555-20c23704f895) Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:10.384027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:45:10.385275 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbd240c2-5898-43d6-bc2f-a2ac79575b88 could not be found. Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 06:45:10.387541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbd240c2-5898-43d6-bc2f-a2ac79575b88 could not be found. Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbd240c2-5898-43d6-bc2f-a2ac79575b88 could not be found. Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ecb2677a-54bc-4622-8acc-3c46e8c14c05 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] Returning 404 to user: Volume fbd240c2-5898-43d6-bc2f-a2ac79575b88 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ecb2677a-54bc-4622-8acc-3c46e8c14c05 tempest-VolumesGetTestJSON-599622231 tempest-VolumesGetTestJSON-599622231-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88" status: 404 len: 109 microversion: 2.1 time: 0.036361 Jul 28 06:45:10.389109 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 537/1073] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:45:10 2022] GET /compute/v2.1/os-volumes/fbd240c2-5898-43d6-bc2f-a2ac79575b88 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:45:11.782020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-79eee296-0e15-476f-8daf-7d04dd7c3fbf tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Action: 'create', calling method: .version_select at 0x7f57476ba670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-528239254", "metadata": {"Type": "work"}}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-79eee296-0e15-476f-8daf-7d04dd7c3fbf tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Request method failure captured: Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 121 Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4jB3TQ7CnURmjlwZOaNrTsB0LHSShrlj51YcYZhzvmUfr4aXgBGKxIkf8cBcNMIkW_nYsv9o6y77v5UARARcWuz4IhYtLF30qSEJuGd0fn0ybUVKl8NbeQXGscyzz3TbV500-5qh4snSquSHQFX9KO6IcvbT6lYxjc5wzRmu0iFvU3g Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:45:11.800663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_794dd8c613a74767b78b43f300930c73", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/794dd8c613a74767b78b43f300930c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}] Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: dc4676fac09649e59e3f6d23796842f9 Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-528239254", "metadata": {"Type": "work"}}} Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: Jul 28 06:45:11.802324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-528239254', 'metadata': {'Type': 'work'}}}} Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise error Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:11.803516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 06:45:11.805191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 06:45:11.806720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 06:45:11.806720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.806720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-79eee296-0e15-476f-8daf-7d04dd7c3fbf tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:11.806720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-79eee296-0e15-476f-8daf-7d04dd7c3fbf tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132880 Jul 28 06:45:11.806720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 537/1074] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Jul 28 06:45:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:45:11.812399 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4074ad73-db8a-4e33-a22e-df8b7fd94e86 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Action: 'create', calling method: .version_select at 0x7f5747763c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1851732954", "metadata": {"Type": "work"}}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4074ad73-db8a-4e33-a22e-df8b7fd94e86 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Request method failure captured: Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 120 Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4jB3TQ7CnURmjlwZOaNrTsB0LHSShrlj51YcYZhzvmUfr4aXgBGKxIkf8cBcNMIkW_nYsv9o6y77v5UARARcWuz4IhYtLF30qSEJuGd0fn0ybUVKl8NbeQXGscyzz3TbV500-5qh4snSquSHQFX9KO6IcvbT6lYxjc5wzRmu0iFvU3g Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:45:11.817793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_794dd8c613a74767b78b43f300930c73", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/794dd8c613a74767b78b43f300930c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}] Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: dc4676fac09649e59e3f6d23796842f9 Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1851732954", "metadata": {"Type": "work"}}} Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: Jul 28 06:45:11.819336 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1851732954', 'metadata': {'Type': 'work'}}}} Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise error Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi '0' Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:11.820379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 06:45:11.821808 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 06:45:11.823054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 06:45:11.823054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.823054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4074ad73-db8a-4e33-a22e-df8b7fd94e86 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:11.823054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4074ad73-db8a-4e33-a22e-df8b7fd94e86 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011317 Jul 28 06:45:11.823054 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 538/1075] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Jul 28 06:45:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 06:45:11.829155 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-73fca1c0-f24a-4081-8c58-62949ea74745 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Action: 'create', calling method: .version_select at 0x7f57477ee670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1818142639", "metadata": {"Type": "work"}}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-73fca1c0-f24a-4081-8c58-62949ea74745 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Request method failure captured: Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 119 Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4jB3TQ7CnURmjlwZOaNrTsB0LHSShrlj51YcYZhzvmUfr4aXgBGKxIkf8cBcNMIkW_nYsv9o6y77v5UARARcWuz4IhYtLF30qSEJuGd0fn0ybUVKl8NbeQXGscyzz3TbV500-5qh4snSquSHQFX9KO6IcvbT6lYxjc5wzRmu0iFvU3g Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:45:11.833387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_794dd8c613a74767b78b43f300930c73", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/794dd8c613a74767b78b43f300930c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}] Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: dc4676fac09649e59e3f6d23796842f9 Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1818142639", "metadata": {"Type": "work"}}} Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: Jul 28 06:45:11.834998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1818142639', 'metadata': {'Type': 'work'}}}} Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise error Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi '' Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:11.835893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 06:45:11.837255 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 06:45:11.838447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 06:45:11.838447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.838447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-73fca1c0-f24a-4081-8c58-62949ea74745 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:11.838447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-73fca1c0-f24a-4081-8c58-62949ea74745 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010263 Jul 28 06:45:11.838447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 538/1076] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Jul 28 06:45:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:45:11.844215 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d37612bd-47ce-4d24-a5cd-45bc3e30bfb8 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Calling method '.version_select at 0x7f5747763a60>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:11.872152 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-d37612bd-47ce-4d24-a5cd-45bc3e30bfb8 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] HTTP exception thrown: Volume tempest-invalid-1760941492 could not be found. Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d37612bd-47ce-4d24-a5cd-45bc3e30bfb8 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Request method failure captured: Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1760941492 HTTP/1.1 Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4jB3TQ7CnURmjlwZOaNrTsB0LHSShrlj51YcYZhzvmUfr4aXgBGKxIkf8cBcNMIkW_nYsv9o6y77v5UARARcWuz4IhYtLF30qSEJuGd0fn0ybUVKl8NbeQXGscyzz3TbV500-5qh4snSquSHQFX9KO6IcvbT6lYxjc5wzRmu0iFvU3g Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:45:11.874209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_794dd8c613a74767b78b43f300930c73", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/794dd8c613a74767b78b43f300930c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}] Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: dc4676fac09649e59e3f6d23796842f9 Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Volume tempest-invalid-1760941492 could not be found. Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': 'tempest-invalid-1760941492'} Jul 28 06:45:11.875840 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1760941492 could not be found. (HTTP 404) (Request-ID: req-8b88cf0e-c3c6-4acb-bded-3e5ab5d95e6f) Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.876862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:45:11.878454 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1760941492 could not be found. Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:11.879834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1760941492 could not be found. Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1760941492 could not be found. Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d37612bd-47ce-4d24-a5cd-45bc3e30bfb8 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Returning 404 to user: Volume tempest-invalid-1760941492 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d37612bd-47ce-4d24-a5cd-45bc3e30bfb8 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1760941492" status: 404 len: 99 microversion: 2.1 time: 0.035717 Jul 28 06:45:11.881332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 539/1077] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Jul 28 06:45:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1760941492 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 06:45:11.885165 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5e9261df-2d7f-4ead-afbe-3a2330c9963a tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003758 Jul 28 06:45:11.885677 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 539/1078] 10.222.0.20 () {58 vars in 1140 bytes} [Thu Jul 28 06:45:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 06:45:11.894867 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ed70a3ce-6a33-4e13-b677-1bd28e84bc53 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004323 Jul 28 06:45:11.895357 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 540/1079] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Jul 28 06:45:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 06:45:11.903670 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a2ef72c7-2368-49b9-a919-c66b5f48683b tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Calling method '.version_select at 0x7f57476ba9d0>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:11.932100 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-a2ef72c7-2368-49b9-a919-c66b5f48683b tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] HTTP exception thrown: Volume ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c could not be found. Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a2ef72c7-2368-49b9-a919-c66b5f48683b tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Request method failure captured: Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: DELETE /compute/v2.1/os-volumes/ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c HTTP/1.1 Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4jB3TQ7CnURmjlwZOaNrTsB0LHSShrlj51YcYZhzvmUfr4aXgBGKxIkf8cBcNMIkW_nYsv9o6y77v5UARARcWuz4IhYtLF30qSEJuGd0fn0ybUVKl8NbeQXGscyzz3TbV500-5qh4snSquSHQFX9KO6IcvbT6lYxjc5wzRmu0iFvU3g Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:45:11.934072 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_794dd8c613a74767b78b43f300930c73", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/794dd8c613a74767b78b43f300930c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}] Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: dc4676fac09649e59e3f6d23796842f9 Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Volume ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c could not be found. Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': 'ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c'} Jul 28 06:45:11.936354 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c could not be found. (HTTP 404) (Request-ID: req-9cf0ea11-c80b-45e6-abee-df00c16718e4) Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.937230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:45:11.938610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c could not be found. Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 06:45:11.940003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c could not be found. Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c could not be found. Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a2ef72c7-2368-49b9-a919-c66b5f48683b tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Returning 404 to user: Volume ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a2ef72c7-2368-49b9-a919-c66b5f48683b tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c" status: 404 len: 109 microversion: 2.1 time: 0.035711 Jul 28 06:45:11.941943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 540/1080] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Jul 28 06:45:11 2022] DELETE /compute/v2.1/os-volumes/ebbd5a58-7d20-4ddb-9e0b-dde1a3cbdb6c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:45:11.945444 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e832d0ba-0148-4b38-acd5-5f7c62174847 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Calling method '.version_select at 0x7f574772e790>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:11.981817 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-e832d0ba-0148-4b38-acd5-5f7c62174847 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] HTTP exception thrown: Volume f9e0ab41-8ea9-432a-a408-f9bc2947fcec could not be found. Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e832d0ba-0148-4b38-acd5-5f7c62174847 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Request method failure captured: Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/os-volumes/f9e0ab41-8ea9-432a-a408-f9bc2947fcec HTTP/1.1 Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4jB3TQ7CnURmjlwZOaNrTsB0LHSShrlj51YcYZhzvmUfr4aXgBGKxIkf8cBcNMIkW_nYsv9o6y77v5UARARcWuz4IhYtLF30qSEJuGd0fn0ybUVKl8NbeQXGscyzz3TbV500-5qh4snSquSHQFX9KO6IcvbT6lYxjc5wzRmu0iFvU3g Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:45:11.984923 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_794dd8c613a74767b78b43f300930c73", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/794dd8c613a74767b78b43f300930c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/794dd8c613a74767b78b43f300930c73"}]}] Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: 794dd8c613a74767b78b43f300930c73 Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-VolumesNegativeTest-1040019716 Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: dc4676fac09649e59e3f6d23796842f9 Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-VolumesNegativeTest-1040019716-project Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Volume f9e0ab41-8ea9-432a-a408-f9bc2947fcec could not be found. Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': 'f9e0ab41-8ea9-432a-a408-f9bc2947fcec'} Jul 28 06:45:11.986383 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9e0ab41-8ea9-432a-a408-f9bc2947fcec could not be found. (HTTP 404) (Request-ID: req-7bcf7c41-82fd-4dc2-8217-8ca530896b33) Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.987283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:45:11.988533 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9e0ab41-8ea9-432a-a408-f9bc2947fcec could not be found. Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 06:45:11.989852 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9e0ab41-8ea9-432a-a408-f9bc2947fcec could not be found. Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9e0ab41-8ea9-432a-a408-f9bc2947fcec could not be found. Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e832d0ba-0148-4b38-acd5-5f7c62174847 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] Returning 404 to user: Volume f9e0ab41-8ea9-432a-a408-f9bc2947fcec could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e832d0ba-0148-4b38-acd5-5f7c62174847 tempest-VolumesNegativeTest-1040019716 tempest-VolumesNegativeTest-1040019716-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f9e0ab41-8ea9-432a-a408-f9bc2947fcec" status: 404 len: 109 microversion: 2.1 time: 0.045180 Jul 28 06:45:11.991495 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 541/1081] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Jul 28 06:45:11 2022] GET /compute/v2.1/os-volumes/f9e0ab41-8ea9-432a-a408-f9bc2947fcec => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:45:17.348281 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-88d59a2a-6a12-42e1-be95-02da2827dfc8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:17.354724 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-88d59a2a-6a12-42e1-be95-02da2827dfc8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:17.355172 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-88d59a2a-6a12-42e1-be95-02da2827dfc8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:17.414203 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-88d59a2a-6a12-42e1-be95-02da2827dfc8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Going to try to stop instance {{(pid=124563) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 06:45:17.458069 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-88d59a2a-6a12-42e1-be95-02da2827dfc8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/action" status: 202 len: 0 microversion: 2.1 time: 0.114455 Jul 28 06:45:17.458686 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 541/1082] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:45:17 2022] POST /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:45:17.464174 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:17.464921 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:17.468976 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-215d951e-2966-40d4-9c4c-751ffadf5af3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:17.469651 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-215d951e-2966-40d4-9c4c-751ffadf5af3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:17.477936 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-215d951e-2966-40d4-9c4c-751ffadf5af3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:17.478248 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-215d951e-2966-40d4-9c4c-751ffadf5af3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:17.479113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-215d951e-2966-40d4-9c4c-751ffadf5af3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:17.479546 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-215d951e-2966-40d4-9c4c-751ffadf5af3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:17.612409 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-215d951e-2966-40d4-9c4c-751ffadf5af3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:17.620344 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-215d951e-2966-40d4-9c4c-751ffadf5af3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.157482 Jul 28 06:45:17.620903 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 542/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:17 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:18.643102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5e7bddff-ffd7-445e-bd20-775e60695776 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:18.643807 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5e7bddff-ffd7-445e-bd20-775e60695776 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:18.652529 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e7bddff-ffd7-445e-bd20-775e60695776 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:18.652981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e7bddff-ffd7-445e-bd20-775e60695776 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:18.653788 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e7bddff-ffd7-445e-bd20-775e60695776 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:18.654237 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5e7bddff-ffd7-445e-bd20-775e60695776 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:18.790349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5e7bddff-ffd7-445e-bd20-775e60695776 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:18.798998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5e7bddff-ffd7-445e-bd20-775e60695776 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.160863 Jul 28 06:45:18.799556 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 542/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:18 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:19.820657 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-36573924-e709-457d-8435-2a3faadd8777 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:19.821270 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-36573924-e709-457d-8435-2a3faadd8777 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:19.828128 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-36573924-e709-457d-8435-2a3faadd8777 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:19.828580 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-36573924-e709-457d-8435-2a3faadd8777 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:19.829425 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-36573924-e709-457d-8435-2a3faadd8777 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:19.829811 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-36573924-e709-457d-8435-2a3faadd8777 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:19.957930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-36573924-e709-457d-8435-2a3faadd8777 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:19.965814 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-36573924-e709-457d-8435-2a3faadd8777 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.149670 Jul 28 06:45:19.966369 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 543/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:19 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:20.986313 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d8c915a7-8083-4ad1-baa4-6ffe353c822d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:20.986918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d8c915a7-8083-4ad1-baa4-6ffe353c822d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:20.993551 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d8c915a7-8083-4ad1-baa4-6ffe353c822d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:20.993993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d8c915a7-8083-4ad1-baa4-6ffe353c822d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:20.994743 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d8c915a7-8083-4ad1-baa4-6ffe353c822d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:20.995174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d8c915a7-8083-4ad1-baa4-6ffe353c822d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:21.124747 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d8c915a7-8083-4ad1-baa4-6ffe353c822d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:21.132619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d8c915a7-8083-4ad1-baa4-6ffe353c822d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.150236 Jul 28 06:45:21.133173 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 543/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:20 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:22.154909 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-820aaa8f-c3a1-4ba1-8d65-c96473ceac73 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:22.155449 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-820aaa8f-c3a1-4ba1-8d65-c96473ceac73 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:22.161939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-820aaa8f-c3a1-4ba1-8d65-c96473ceac73 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:22.162393 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-820aaa8f-c3a1-4ba1-8d65-c96473ceac73 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:22.163143 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-820aaa8f-c3a1-4ba1-8d65-c96473ceac73 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:22.163572 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-820aaa8f-c3a1-4ba1-8d65-c96473ceac73 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:22.298906 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-820aaa8f-c3a1-4ba1-8d65-c96473ceac73 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:22.306919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-820aaa8f-c3a1-4ba1-8d65-c96473ceac73 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.156203 Jul 28 06:45:22.307479 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 544/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:22 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:23.329125 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-53adc9b4-26c4-4445-8e96-f23391016d01 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:23.329794 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-53adc9b4-26c4-4445-8e96-f23391016d01 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:23.332157 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:23.337578 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-53adc9b4-26c4-4445-8e96-f23391016d01 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:23.338022 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-53adc9b4-26c4-4445-8e96-f23391016d01 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:23.338778 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-53adc9b4-26c4-4445-8e96-f23391016d01 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:23.339211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-53adc9b4-26c4-4445-8e96-f23391016d01 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:23.476277 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-53adc9b4-26c4-4445-8e96-f23391016d01 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:23.484449 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-53adc9b4-26c4-4445-8e96-f23391016d01 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.160020 Jul 28 06:45:23.485012 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 544/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:23 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:24.506978 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9202b908-818d-48ad-b71a-fff20b4440a2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:24.508835 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9202b908-818d-48ad-b71a-fff20b4440a2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:24.517263 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9202b908-818d-48ad-b71a-fff20b4440a2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:24.517750 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9202b908-818d-48ad-b71a-fff20b4440a2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:24.518509 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9202b908-818d-48ad-b71a-fff20b4440a2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:24.518939 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9202b908-818d-48ad-b71a-fff20b4440a2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:24.683014 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9202b908-818d-48ad-b71a-fff20b4440a2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:24.693452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9202b908-818d-48ad-b71a-fff20b4440a2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.191448 Jul 28 06:45:24.694774 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 545/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:24 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:25.714757 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9201ae35-24b9-4f7f-a00e-6d88cd4c700e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:25.715284 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9201ae35-24b9-4f7f-a00e-6d88cd4c700e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:25.722625 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9201ae35-24b9-4f7f-a00e-6d88cd4c700e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:25.723068 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9201ae35-24b9-4f7f-a00e-6d88cd4c700e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:25.723850 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9201ae35-24b9-4f7f-a00e-6d88cd4c700e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:25.724260 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9201ae35-24b9-4f7f-a00e-6d88cd4c700e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:25.855902 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9201ae35-24b9-4f7f-a00e-6d88cd4c700e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:25.865334 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9201ae35-24b9-4f7f-a00e-6d88cd4c700e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.154455 Jul 28 06:45:25.865907 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 545/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:25 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:26.887446 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-61e141ab-5d17-40d0-96b4-7871e2c21cd9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:26.888397 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-61e141ab-5d17-40d0-96b4-7871e2c21cd9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:26.895728 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61e141ab-5d17-40d0-96b4-7871e2c21cd9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:26.896185 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61e141ab-5d17-40d0-96b4-7871e2c21cd9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:26.897779 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61e141ab-5d17-40d0-96b4-7871e2c21cd9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:26.898311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-61e141ab-5d17-40d0-96b4-7871e2c21cd9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:27.040087 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-61e141ab-5d17-40d0-96b4-7871e2c21cd9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:27.049518 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-61e141ab-5d17-40d0-96b4-7871e2c21cd9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.165881 Jul 28 06:45:27.050160 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 546/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:26 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:28.071370 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-768889d6-b3d3-453d-8088-20941cc9f280 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:28.071804 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-768889d6-b3d3-453d-8088-20941cc9f280 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:28.078577 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-768889d6-b3d3-453d-8088-20941cc9f280 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:28.079019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-768889d6-b3d3-453d-8088-20941cc9f280 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:28.079781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-768889d6-b3d3-453d-8088-20941cc9f280 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:28.080229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-768889d6-b3d3-453d-8088-20941cc9f280 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:28.165705 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1591884593", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-306828582", "security_groups": [{"name": "tempest-secgroup-smoke-1325947969"}], "block_device_mapping_v2": [{"uuid": "b8687953-d210-4c41-8f5e-86c9c3375dd3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eec19e8-2941-4311-8a4f-2b98c90d5895"}]}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:28.218795 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-768889d6-b3d3-453d-8088-20941cc9f280 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:28.227823 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-768889d6-b3d3-453d-8088-20941cc9f280 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.160402 Jul 28 06:45:28.228393 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 546/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:28 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:28.288027 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.network.neutron [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] validate_networks() for [('5eec19e8-2941-4311-8a4f-2b98c90d5895', None, None, None, None, None)] {{(pid=124562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:45:28.799311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Flavor limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:45:28.799729 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Image limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:45:28.800193 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Flavor pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:45:28.800611 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Image pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:45:28.801016 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:45:28.809741 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:28.810181 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:28.810968 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:28.811501 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:28.828760 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Getting quotas for project f16eee0fb716452e8c760a27b5724d91. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:45:28.832668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Getting quotas for user 13ca4be686f84c279f87016c20129833 and project f16eee0fb716452e8c760a27b5724d91. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:45:28.890093 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Going to run 1 instances... {{(pid=124562) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:45:28.892312 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8687953-d210-4c41-8f5e-86c9c3375dd3',volume_size=None,volume_type=None)] {{(pid=124562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:45:29.019862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR oslo.messaging._drivers.impl_rabbit [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [e74fb46c-dbaa-485b-a043-a2de2265a787] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 06:45:29.250069 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6c7ae807-a342-4a65-8cbb-93febbda354c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:29.250695 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6c7ae807-a342-4a65-8cbb-93febbda354c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:29.257535 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c7ae807-a342-4a65-8cbb-93febbda354c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:29.258090 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c7ae807-a342-4a65-8cbb-93febbda354c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:29.258928 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c7ae807-a342-4a65-8cbb-93febbda354c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:29.259368 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6c7ae807-a342-4a65-8cbb-93febbda354c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:29.396642 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6c7ae807-a342-4a65-8cbb-93febbda354c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:29.405208 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6c7ae807-a342-4a65-8cbb-93febbda354c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.159498 Jul 28 06:45:29.405712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 547/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:29 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:45:29.410777 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-495879c1-6788-480a-8fc8-58c6ffff0249 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:29.412645 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-495879c1-6788-480a-8fc8-58c6ffff0249 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:29.418742 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-495879c1-6788-480a-8fc8-58c6ffff0249 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:29.419240 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-495879c1-6788-480a-8fc8-58c6ffff0249 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:29.420097 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-495879c1-6788-480a-8fc8-58c6ffff0249 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:29.420627 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-495879c1-6788-480a-8fc8-58c6ffff0249 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:29.454268 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-495879c1-6788-480a-8fc8-58c6ffff0249 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047473 Jul 28 06:45:29.454838 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 548/1094] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Jul 28 06:45:29 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:29.517327 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-43655dc8-1ef1-40bf-9907-d9c1885c2be2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:29.517860 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-43655dc8-1ef1-40bf-9907-d9c1885c2be2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:29.523990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-43655dc8-1ef1-40bf-9907-d9c1885c2be2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:29.524441 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-43655dc8-1ef1-40bf-9907-d9c1885c2be2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:29.525210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-43655dc8-1ef1-40bf-9907-d9c1885c2be2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:29.525678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-43655dc8-1ef1-40bf-9907-d9c1885c2be2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:29.550926 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-43655dc8-1ef1-40bf-9907-d9c1885c2be2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Going to try to terminate instance {{(pid=124563) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:45:29.625630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-43655dc8-1ef1-40bf-9907-d9c1885c2be2 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 204 len: 0 microversion: 2.20 time: 0.112447 Jul 28 06:45:29.626449 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 549/1095] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Jul 28 06:45:29 2022] DELETE /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 06:45:29.635241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-02294767-6651-44e8-92ad-c5687ade237f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:29.635967 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-02294767-6651-44e8-92ad-c5687ade237f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:29.642440 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-02294767-6651-44e8-92ad-c5687ade237f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:29.642893 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-02294767-6651-44e8-92ad-c5687ade237f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:29.643666 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-02294767-6651-44e8-92ad-c5687ade237f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:29.644125 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-02294767-6651-44e8-92ad-c5687ade237f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:29.808118 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-02294767-6651-44e8-92ad-c5687ade237f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:29.818006 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-02294767-6651-44e8-92ad-c5687ade237f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:29.819502 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-02294767-6651-44e8-92ad-c5687ade237f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:29.820662 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-02294767-6651-44e8-92ad-c5687ade237f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.189926 Jul 28 06:45:29.821216 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 550/1096] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:45:29 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:45:30.029549 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO oslo.messaging._drivers.impl_rabbit [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [e74fb46c-dbaa-485b-a043-a2de2265a787] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52704. Jul 28 06:45:30.035082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-775c2da2-6a9b-48af-8c6d-7156851da79e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.873379 Jul 28 06:45:30.042638 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 547/1097] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:45:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 06:45:30.048612 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d61259a0-79ea-4a74-8433-535531ba78c1 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:30.049238 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d61259a0-79ea-4a74-8433-535531ba78c1 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:30.106040 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d61259a0-79ea-4a74-8433-535531ba78c1 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:30.114019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d61259a0-79ea-4a74-8433-535531ba78c1 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1094 microversion: 2.1 time: 0.071023 Jul 28 06:45:30.114799 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 551/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:30 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:30.428057 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9707727a-7f1a-4920-b893-e7ed207eed96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:30.428695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9707727a-7f1a-4920-b893-e7ed207eed96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:30.440457 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9707727a-7f1a-4920-b893-e7ed207eed96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:30.441247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9707727a-7f1a-4920-b893-e7ed207eed96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:30.442052 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9707727a-7f1a-4920-b893-e7ed207eed96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:30.442484 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9707727a-7f1a-4920-b893-e7ed207eed96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:30.580924 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9707727a-7f1a-4920-b893-e7ed207eed96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:30.589087 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9707727a-7f1a-4920-b893-e7ed207eed96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.165318 Jul 28 06:45:30.589692 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 548/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:30 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:30.844508 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-71ce59f6-fb08-4e1c-b295-defb3e78ed4f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:30.845248 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-71ce59f6-fb08-4e1c-b295-defb3e78ed4f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:30.852554 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71ce59f6-fb08-4e1c-b295-defb3e78ed4f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:30.853011 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71ce59f6-fb08-4e1c-b295-defb3e78ed4f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:30.853811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71ce59f6-fb08-4e1c-b295-defb3e78ed4f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:30.854251 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-71ce59f6-fb08-4e1c-b295-defb3e78ed4f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:30.991038 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-71ce59f6-fb08-4e1c-b295-defb3e78ed4f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:30.999839 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-71ce59f6-fb08-4e1c-b295-defb3e78ed4f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:31.001569 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-71ce59f6-fb08-4e1c-b295-defb3e78ed4f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:31.002773 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-71ce59f6-fb08-4e1c-b295-defb3e78ed4f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.162793 Jul 28 06:45:31.005835 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 552/1100] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:45:30 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:45:31.134978 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-77abe03f-108b-4b3b-9d8a-64a393cc623b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:31.135742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-77abe03f-108b-4b3b-9d8a-64a393cc623b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:31.142537 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77abe03f-108b-4b3b-9d8a-64a393cc623b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:31.143074 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77abe03f-108b-4b3b-9d8a-64a393cc623b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:31.143917 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77abe03f-108b-4b3b-9d8a-64a393cc623b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:31.144426 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-77abe03f-108b-4b3b-9d8a-64a393cc623b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:31.227262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-77abe03f-108b-4b3b-9d8a-64a393cc623b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:31.235411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-77abe03f-108b-4b3b-9d8a-64a393cc623b tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1136 microversion: 2.1 time: 0.104287 Jul 28 06:45:31.236080 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 549/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:31 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1136 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:31.613152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-bb2cf4c9-ebe8-48ef-88e3-7f0b7a2d2b2d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:31.614067 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-bb2cf4c9-ebe8-48ef-88e3-7f0b7a2d2b2d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:31.621453 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bb2cf4c9-ebe8-48ef-88e3-7f0b7a2d2b2d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:31.622121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bb2cf4c9-ebe8-48ef-88e3-7f0b7a2d2b2d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:31.623280 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bb2cf4c9-ebe8-48ef-88e3-7f0b7a2d2b2d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:31.624394 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-bb2cf4c9-ebe8-48ef-88e3-7f0b7a2d2b2d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:31.777341 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-bb2cf4c9-ebe8-48ef-88e3-7f0b7a2d2b2d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:31.785375 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:31.793650 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-bb2cf4c9-ebe8-48ef-88e3-7f0b7a2d2b2d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.187101 Jul 28 06:45:31.794678 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 553/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:31 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:45:32.030181 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f765bdba-1b1e-4fda-8a62-f349ff5af20f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:32.030783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f765bdba-1b1e-4fda-8a62-f349ff5af20f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:32.037038 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f765bdba-1b1e-4fda-8a62-f349ff5af20f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:32.037428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f765bdba-1b1e-4fda-8a62-f349ff5af20f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:32.038205 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f765bdba-1b1e-4fda-8a62-f349ff5af20f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:32.038820 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f765bdba-1b1e-4fda-8a62-f349ff5af20f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:32.234294 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f765bdba-1b1e-4fda-8a62-f349ff5af20f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:32.257191 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-085e84ac-8ae2-4cbf-80e6-ba4250985203 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:32.257852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-085e84ac-8ae2-4cbf-80e6-ba4250985203 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:32.271471 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-085e84ac-8ae2-4cbf-80e6-ba4250985203 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:32.271920 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-085e84ac-8ae2-4cbf-80e6-ba4250985203 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:32.272690 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-085e84ac-8ae2-4cbf-80e6-ba4250985203 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:32.276332 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f765bdba-1b1e-4fda-8a62-f349ff5af20f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:32.277862 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f765bdba-1b1e-4fda-8a62-f349ff5af20f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:32.279514 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-085e84ac-8ae2-4cbf-80e6-ba4250985203 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:32.284506 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f765bdba-1b1e-4fda-8a62-f349ff5af20f tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1722 microversion: 2.20 time: 0.261849 Jul 28 06:45:32.286441 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 550/1103] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:45:32 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:45:32.377739 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-085e84ac-8ae2-4cbf-80e6-ba4250985203 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:32.386239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-085e84ac-8ae2-4cbf-80e6-ba4250985203 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1200 microversion: 2.1 time: 0.133696 Jul 28 06:45:32.387464 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 554/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:32 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1200 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:32.824805 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-15f0de15-328e-404e-9ba7-e3464a1853bc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:32.827895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-15f0de15-328e-404e-9ba7-e3464a1853bc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:32.846617 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-29995efe-4d54-496d-9763-4108d23a086e req-42d1ef88-1f1b-4d4d-99b8-352e20a3def7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163a335a-d407-4ec6-9c94-f0d8e37e83d4", "name": "network-vif-deleted", "tag": "dc86c76c-8061-4d08-8a5f-ec9bba7801ad"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:32.851603 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15f0de15-328e-404e-9ba7-e3464a1853bc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:32.852064 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15f0de15-328e-404e-9ba7-e3464a1853bc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:32.852952 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15f0de15-328e-404e-9ba7-e3464a1853bc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:32.853665 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-15f0de15-328e-404e-9ba7-e3464a1853bc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:32.869439 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-29995efe-4d54-496d-9763-4108d23a086e req-42d1ef88-1f1b-4d4d-99b8-352e20a3def7 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:32.869917 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-29995efe-4d54-496d-9763-4108d23a086e req-42d1ef88-1f1b-4d4d-99b8-352e20a3def7 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:32.900653 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-29995efe-4d54-496d-9763-4108d23a086e req-42d1ef88-1f1b-4d4d-99b8-352e20a3def7 service nova] Creating event network-vif-deleted:dc86c76c-8061-4d08-8a5f-ec9bba7801ad for instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 on hv-cinder-85060 Jul 28 06:45:32.911540 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-29995efe-4d54-496d-9763-4108d23a086e req-42d1ef88-1f1b-4d4d-99b8-352e20a3def7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069898 Jul 28 06:45:32.914209 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 555/1105] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:45:33.126234 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-15f0de15-328e-404e-9ba7-e3464a1853bc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:33.137788 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-15f0de15-328e-404e-9ba7-e3464a1853bc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.323358 Jul 28 06:45:33.146266 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 551/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:32 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:33.312164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:33.313988 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:33.322781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:33.323557 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:33.325634 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:33.326412 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:33.397576 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:33.398566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:33.404902 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lazy-loading 'fault' on Instance uuid 163a335a-d407-4ec6-9c94-f0d8e37e83d4 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:45:33.408507 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-34e32301-2cf5-445b-b218-40655055695c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:33.409165 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-34e32301-2cf5-445b-b218-40655055695c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:33.422229 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-34e32301-2cf5-445b-b218-40655055695c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:33.422877 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-34e32301-2cf5-445b-b218-40655055695c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:33.431018 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-34e32301-2cf5-445b-b218-40655055695c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:33.431018 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-34e32301-2cf5-445b-b218-40655055695c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:33.519466 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:33.531275 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:33.533112 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf13ae714ad04d6696c273603bba9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0dc09f9844b57bf7b38a5d4e54e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:33.535507 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b0e48763-cc19-4374-b519-3bb4caa31aa7 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 200 len: 1371 microversion: 2.20 time: 0.228718 Jul 28 06:45:33.536071 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 556/1107] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:45:33 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:45:33.756322 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-34e32301-2cf5-445b-b218-40655055695c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:33.765795 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-34e32301-2cf5-445b-b218-40655055695c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1278 microversion: 2.1 time: 0.361483 Jul 28 06:45:33.766374 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 552/1108] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:33 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1278 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:34.165978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-406a2b88-acb7-4ea9-9df8-49be6cce5cb7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:34.166482 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-406a2b88-acb7-4ea9-9df8-49be6cce5cb7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:34.174959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-406a2b88-acb7-4ea9-9df8-49be6cce5cb7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:34.176049 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-406a2b88-acb7-4ea9-9df8-49be6cce5cb7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:34.177661 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-406a2b88-acb7-4ea9-9df8-49be6cce5cb7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:34.178183 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-406a2b88-acb7-4ea9-9df8-49be6cce5cb7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:34.355635 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-406a2b88-acb7-4ea9-9df8-49be6cce5cb7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:34.364613 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-406a2b88-acb7-4ea9-9df8-49be6cce5cb7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.205247 Jul 28 06:45:34.366166 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 557/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:34 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:34.566719 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2c0badb7-1fa2-4c0b-b849-3ba18c59b926 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:34.568202 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2c0badb7-1fa2-4c0b-b849-3ba18c59b926 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:34.575552 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2c0badb7-1fa2-4c0b-b849-3ba18c59b926 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:34.576267 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2c0badb7-1fa2-4c0b-b849-3ba18c59b926 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:34.577491 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2c0badb7-1fa2-4c0b-b849-3ba18c59b926 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:34.578131 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2c0badb7-1fa2-4c0b-b849-3ba18c59b926 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:34.594320 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-2c0badb7-1fa2-4c0b-b849-3ba18c59b926 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] HTTP exception thrown: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2c0badb7-1fa2-4c0b-b849-3ba18c59b926 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Request method failure captured: Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 HTTP/1.1 Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6b8O3pYD7VnRIzhBncIQzjFR54g8lp8_mRMFsLgqHHWC-hT0Hy0D8sVexpjDErylru-WXRcMr07Nyc3ikMCEdfoLwxPVbN2hySS9tZXaTbY6yTlPK6LLXEwkkbDK_JtWMZ9oBh0G_GnJHuELoqo4Z_iah7eXfMeLBkZDCScoQpaPo Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:45:34.595882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9e0dc09f9844b57bf7b38a5d4e54e17", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}] Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: cf13ae714ad04d6696c273603bba9fbc Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:34.597633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '163a335a-d407-4ec6-9c94-f0d8e37e83d4'} Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:34.598649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:34.599986 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:34.601361 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2c0badb7-1fa2-4c0b-b849-3ba18c59b926 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Returning 404 to user: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:34.601361 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2c0badb7-1fa2-4c0b-b849-3ba18c59b926 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 404 len: 111 microversion: 2.20 time: 0.035072 Jul 28 06:45:34.601361 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 553/1110] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:45:34 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:45:34.611856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f71c6e46-7318-41c3-8314-1bfa5f2b2ee3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '.version_select at 0x7f57477eea60>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:34.640634 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f71c6e46-7318-41c3-8314-1bfa5f2b2ee3 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-591201761" status: 204 len: 0 microversion: 2.20 time: 0.037371 Jul 28 06:45:34.645324 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 558/1111] 10.222.0.20 () {60 vars in 1259 bytes} [Thu Jul 28 06:45:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-591201761 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 06:45:34.786282 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-63a26078-f0e0-4a19-a7b2-cf34ca426936 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:34.786894 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-63a26078-f0e0-4a19-a7b2-cf34ca426936 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:34.793571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-63a26078-f0e0-4a19-a7b2-cf34ca426936 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:34.794026 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-63a26078-f0e0-4a19-a7b2-cf34ca426936 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:34.794812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-63a26078-f0e0-4a19-a7b2-cf34ca426936 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:34.795328 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-63a26078-f0e0-4a19-a7b2-cf34ca426936 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:34.957945 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-66654547-71a8-4d87-b95b-b624de08ecbe req-96ba77a3-ddf4-4d26-88cc-4cb422db6a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c7a397-7e30-4f41-aa11-751a55aed898", "tag": "32380163-a382-4b44-b96f-ac530b2c0610"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:34.968652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-66654547-71a8-4d87-b95b-b624de08ecbe req-96ba77a3-ddf4-4d26-88cc-4cb422db6a83 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:34.970083 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-66654547-71a8-4d87-b95b-b624de08ecbe req-96ba77a3-ddf4-4d26-88cc-4cb422db6a83 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:34.996550 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-66654547-71a8-4d87-b95b-b624de08ecbe req-96ba77a3-ddf4-4d26-88cc-4cb422db6a83 service nova] Creating event network-changed:32380163-a382-4b44-b96f-ac530b2c0610 for instance 31c7a397-7e30-4f41-aa11-751a55aed898 on hv-cinder-85060 Jul 28 06:45:35.001874 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-66654547-71a8-4d87-b95b-b624de08ecbe req-96ba77a3-ddf4-4d26-88cc-4cb422db6a83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047861 Jul 28 06:45:35.002652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 559/1112] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:45:35.069768 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-63a26078-f0e0-4a19-a7b2-cf34ca426936 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:35.078864 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-63a26078-f0e0-4a19-a7b2-cf34ca426936 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.296359 Jul 28 06:45:35.088557 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 554/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:34 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:35.387944 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c4ff48a8-eadc-407d-96af-b74fd7d248fb tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:35.389638 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c4ff48a8-eadc-407d-96af-b74fd7d248fb tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:35.403573 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c4ff48a8-eadc-407d-96af-b74fd7d248fb tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:35.404395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c4ff48a8-eadc-407d-96af-b74fd7d248fb tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:35.405681 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c4ff48a8-eadc-407d-96af-b74fd7d248fb tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:35.405923 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c4ff48a8-eadc-407d-96af-b74fd7d248fb tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:35.556377 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c4ff48a8-eadc-407d-96af-b74fd7d248fb tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:35.566663 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c4ff48a8-eadc-407d-96af-b74fd7d248fb tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.183315 Jul 28 06:45:35.567237 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 560/1114] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:35 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:36.099913 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f08151bf-27fd-4ae6-858b-64892066aab7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:36.100527 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f08151bf-27fd-4ae6-858b-64892066aab7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:36.107017 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f08151bf-27fd-4ae6-858b-64892066aab7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:36.107474 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f08151bf-27fd-4ae6-858b-64892066aab7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:36.109074 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f08151bf-27fd-4ae6-858b-64892066aab7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:36.109546 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f08151bf-27fd-4ae6-858b-64892066aab7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:36.250698 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f08151bf-27fd-4ae6-858b-64892066aab7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:36.258150 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f08151bf-27fd-4ae6-858b-64892066aab7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.162094 Jul 28 06:45:36.258714 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 555/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:36 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:36.563772 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-499f6e59-4e36-45bb-b20d-d0f74309bd6b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:36.564256 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-499f6e59-4e36-45bb-b20d-d0f74309bd6b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:36.571244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-499f6e59-4e36-45bb-b20d-d0f74309bd6b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:36.571701 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-499f6e59-4e36-45bb-b20d-d0f74309bd6b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:36.572507 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-499f6e59-4e36-45bb-b20d-d0f74309bd6b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:36.572950 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-499f6e59-4e36-45bb-b20d-d0f74309bd6b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:36.586713 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-499f6e59-4e36-45bb-b20d-d0f74309bd6b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] HTTP exception thrown: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:36.587911 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2764b7eb-49e3-4569-82c6-a29754eaeac0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:36.588520 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2764b7eb-49e3-4569-82c6-a29754eaeac0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-499f6e59-4e36-45bb-b20d-d0f74309bd6b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Request method failure captured: Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: DELETE /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 HTTP/1.1 Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6b8O3pYD7VnRIzhBncIQzjFR54g8lp8_mRMFsLgqHHWC-hT0Hy0D8sVexpjDErylru-WXRcMr07Nyc3ikMCEdfoLwxPVbN2hySS9tZXaTbY6yTlPK6LLXEwkkbDK_JtWMZ9oBh0G_GnJHuELoqo4Z_iah7eXfMeLBkZDCScoQpaPo Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:45:36.588798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9e0dc09f9844b57bf7b38a5d4e54e17", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}] Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: cf13ae714ad04d6696c273603bba9fbc Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:36.590521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '163a335a-d407-4ec6-9c94-f0d8e37e83d4'} Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:36.591624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:36.593993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:36.595868 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-499f6e59-4e36-45bb-b20d-d0f74309bd6b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Returning 404 to user: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:36.595868 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-499f6e59-4e36-45bb-b20d-d0f74309bd6b tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 404 len: 111 microversion: 2.20 time: 0.030482 Jul 28 06:45:36.595868 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 561/1116] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Jul 28 06:45:36 2022] DELETE /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:45:36.596121 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2764b7eb-49e3-4569-82c6-a29754eaeac0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:36.596121 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2764b7eb-49e3-4569-82c6-a29754eaeac0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:36.596578 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2764b7eb-49e3-4569-82c6-a29754eaeac0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:36.597015 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2764b7eb-49e3-4569-82c6-a29754eaeac0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:36.599899 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d6cdf57e-9465-4beb-8db5-27986da84905 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:36.600497 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d6cdf57e-9465-4beb-8db5-27986da84905 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 163a335a-d407-4ec6-9c94-f0d8e37e83d4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:36.606431 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d6cdf57e-9465-4beb-8db5-27986da84905 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:36.606881 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d6cdf57e-9465-4beb-8db5-27986da84905 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:36.607648 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d6cdf57e-9465-4beb-8db5-27986da84905 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:36.608340 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d6cdf57e-9465-4beb-8db5-27986da84905 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:36.621615 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-d6cdf57e-9465-4beb-8db5-27986da84905 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] HTTP exception thrown: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d6cdf57e-9465-4beb-8db5-27986da84905 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Request method failure captured: Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 HTTP/1.1 Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6b8O3pYD7VnRIzhBncIQzjFR54g8lp8_mRMFsLgqHHWC-hT0Hy0D8sVexpjDErylru-WXRcMr07Nyc3ikMCEdfoLwxPVbN2hySS9tZXaTbY6yTlPK6LLXEwkkbDK_JtWMZ9oBh0G_GnJHuELoqo4Z_iah7eXfMeLBkZDCScoQpaPo Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:45:36.623152 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9e0dc09f9844b57bf7b38a5d4e54e17", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}] Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: cf13ae714ad04d6696c273603bba9fbc Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:36.624918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '163a335a-d407-4ec6-9c94-f0d8e37e83d4'} Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:36.625998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. Jul 28 06:45:36.627571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:36.628900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d6cdf57e-9465-4beb-8db5-27986da84905 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Returning 404 to user: Instance 163a335a-d407-4ec6-9c94-f0d8e37e83d4 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:36.628900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d6cdf57e-9465-4beb-8db5-27986da84905 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4" status: 404 len: 111 microversion: 2.20 time: 0.029051 Jul 28 06:45:36.628900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 562/1117] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:45:36 2022] GET /compute/v2.1/servers/163a335a-d407-4ec6-9c94-f0d8e37e83d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 06:45:36.738299 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2764b7eb-49e3-4569-82c6-a29754eaeac0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:36.746426 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2764b7eb-49e3-4569-82c6-a29754eaeac0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.162467 Jul 28 06:45:36.746990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 556/1118] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:36 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:45:37.279100 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9a811d1f-f0c4-48b3-9b62-175849db1df6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:37.279719 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9a811d1f-f0c4-48b3-9b62-175849db1df6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:37.285959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9a811d1f-f0c4-48b3-9b62-175849db1df6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:37.286470 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9a811d1f-f0c4-48b3-9b62-175849db1df6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:37.287232 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9a811d1f-f0c4-48b3-9b62-175849db1df6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:37.287674 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9a811d1f-f0c4-48b3-9b62-175849db1df6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:37.418829 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9a811d1f-f0c4-48b3-9b62-175849db1df6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:37.427306 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9a811d1f-f0c4-48b3-9b62-175849db1df6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.152149 Jul 28 06:45:37.427865 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 563/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:37 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:37.768018 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-88e8dc82-4de7-4b89-9e37-6a11493028c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:37.768624 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-88e8dc82-4de7-4b89-9e37-6a11493028c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:37.775023 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-88e8dc82-4de7-4b89-9e37-6a11493028c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:37.775463 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-88e8dc82-4de7-4b89-9e37-6a11493028c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:37.776218 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-88e8dc82-4de7-4b89-9e37-6a11493028c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:37.776647 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-88e8dc82-4de7-4b89-9e37-6a11493028c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:37.909755 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-88e8dc82-4de7-4b89-9e37-6a11493028c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:37.917805 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-88e8dc82-4de7-4b89-9e37-6a11493028c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.153605 Jul 28 06:45:37.918365 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 557/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:37 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:38.449926 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-76099d9c-300a-44d0-84b2-3573933128f6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:38.450586 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-76099d9c-300a-44d0-84b2-3573933128f6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:38.458001 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-76099d9c-300a-44d0-84b2-3573933128f6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:38.458483 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-76099d9c-300a-44d0-84b2-3573933128f6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:38.459247 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-76099d9c-300a-44d0-84b2-3573933128f6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:38.459682 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-76099d9c-300a-44d0-84b2-3573933128f6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:38.610381 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-76099d9c-300a-44d0-84b2-3573933128f6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:38.617924 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-76099d9c-300a-44d0-84b2-3573933128f6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.171932 Jul 28 06:45:38.618485 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 564/1121] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:38 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:38.940748 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4d51e3ff-8491-4a0a-940e-4b1797b67fd1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:38.942122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4d51e3ff-8491-4a0a-940e-4b1797b67fd1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:38.945807 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:38.946863 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=6 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:38.953782 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4d51e3ff-8491-4a0a-940e-4b1797b67fd1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:38.954226 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4d51e3ff-8491-4a0a-940e-4b1797b67fd1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:38.955003 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4d51e3ff-8491-4a0a-940e-4b1797b67fd1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:38.955442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4d51e3ff-8491-4a0a-940e-4b1797b67fd1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:39.160842 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4d51e3ff-8491-4a0a-940e-4b1797b67fd1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:39.170728 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4d51e3ff-8491-4a0a-940e-4b1797b67fd1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1721 microversion: 2.1 time: 0.235009 Jul 28 06:45:39.181334 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 558/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:38 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:45:39.639631 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-60b9b096-7bb8-4517-9cbb-103107779b36 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:39.640247 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-60b9b096-7bb8-4517-9cbb-103107779b36 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:39.646849 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-60b9b096-7bb8-4517-9cbb-103107779b36 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:39.647304 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-60b9b096-7bb8-4517-9cbb-103107779b36 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:39.648069 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-60b9b096-7bb8-4517-9cbb-103107779b36 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:39.648510 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-60b9b096-7bb8-4517-9cbb-103107779b36 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:39.783811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-60b9b096-7bb8-4517-9cbb-103107779b36 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:39.791441 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-60b9b096-7bb8-4517-9cbb-103107779b36 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.155940 Jul 28 06:45:39.792004 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 565/1123] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:39 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:39.875515 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6b96378d-21b8-435d-bd3a-bbd65516133e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:39.876032 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6b96378d-21b8-435d-bd3a-bbd65516133e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:39.881966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6b96378d-21b8-435d-bd3a-bbd65516133e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:39.882407 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6b96378d-21b8-435d-bd3a-bbd65516133e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:39.883160 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6b96378d-21b8-435d-bd3a-bbd65516133e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:39.883590 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6b96378d-21b8-435d-bd3a-bbd65516133e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:39.898424 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-6b96378d-21b8-435d-bd3a-bbd65516133e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] HTTP exception thrown: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6b96378d-21b8-435d-bd3a-bbd65516133e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Request method failure captured: Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 HTTP/1.1 Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i6b8O3pYD7VnRIzhBncIQzjFR54g8lp8_mRMFsLgqHHWC-hT0Hy0D8sVexpjDErylru-WXRcMr07Nyc3ikMCEdfoLwxPVbN2hySS9tZXaTbY6yTlPK6LLXEwkkbDK_JtWMZ9oBh0G_GnJHuELoqo4Z_iah7eXfMeLBkZDCScoQpaPo Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:45:39.899938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9e0dc09f9844b57bf7b38a5d4e54e17", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}] Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: cf13ae714ad04d6696c273603bba9fbc Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:45:39.901685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '019e1e9c-7545-477a-bae9-47c555ae07e2'} Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:39.902804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:45:39.904283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:45:39.906707 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6b96378d-21b8-435d-bd3a-bbd65516133e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Returning 404 to user: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:39.906707 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6b96378d-21b8-435d-bd3a-bbd65516133e tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 404 len: 111 microversion: 2.20 time: 0.029663 Jul 28 06:45:39.906707 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 559/1124] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Jul 28 06:45:39 2022] DELETE /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:45:39.910239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e8039f93-479c-41a3-8474-ebb1b19d5655 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:39.910852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e8039f93-479c-41a3-8474-ebb1b19d5655 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] [instance: 019e1e9c-7545-477a-bae9-47c555ae07e2] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:39.916798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8039f93-479c-41a3-8474-ebb1b19d5655 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:39.917252 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8039f93-479c-41a3-8474-ebb1b19d5655 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:39.918059 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8039f93-479c-41a3-8474-ebb1b19d5655 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:39.918500 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e8039f93-479c-41a3-8474-ebb1b19d5655 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:39.934349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-e8039f93-479c-41a3-8474-ebb1b19d5655 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] HTTP exception thrown: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e8039f93-479c-41a3-8474-ebb1b19d5655 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Request method failure captured: Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 HTTP/1.1 Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i6b8O3pYD7VnRIzhBncIQzjFR54g8lp8_mRMFsLgqHHWC-hT0Hy0D8sVexpjDErylru-WXRcMr07Nyc3ikMCEdfoLwxPVbN2hySS9tZXaTbY6yTlPK6LLXEwkkbDK_JtWMZ9oBh0G_GnJHuELoqo4Z_iah7eXfMeLBkZDCScoQpaPo Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:45:39.935925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9e0dc09f9844b57bf7b38a5d4e54e17", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9e0dc09f9844b57bf7b38a5d4e54e17"}]}] Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: d9e0dc09f9844b57bf7b38a5d4e54e17 Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130138587 Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: cf13ae714ad04d6696c273603bba9fbc Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130138587-project Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:45:39.937765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '019e1e9c-7545-477a-bae9-47c555ae07e2'} Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:45:39.938877 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. Jul 28 06:45:39.940428 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:45:39.942422 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e8039f93-479c-41a3-8474-ebb1b19d5655 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] Returning 404 to user: Instance 019e1e9c-7545-477a-bae9-47c555ae07e2 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:45:39.942422 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e8039f93-479c-41a3-8474-ebb1b19d5655 tempest-AttachVolumeShelveTestJSON-1130138587 tempest-AttachVolumeShelveTestJSON-1130138587-project] 10.222.0.20 "GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2" status: 404 len: 111 microversion: 2.20 time: 0.031035 Jul 28 06:45:39.942422 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 566/1125] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 28 06:45:39 2022] GET /compute/v2.1/servers/019e1e9c-7545-477a-bae9-47c555ae07e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:45:40.196338 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-01e72ca8-396c-4aee-8622-31098856bb0b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:40.197135 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-01e72ca8-396c-4aee-8622-31098856bb0b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:40.204492 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01e72ca8-396c-4aee-8622-31098856bb0b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:40.204943 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01e72ca8-396c-4aee-8622-31098856bb0b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:40.205745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01e72ca8-396c-4aee-8622-31098856bb0b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:40.206385 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01e72ca8-396c-4aee-8622-31098856bb0b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:40.225644 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=100 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:40.342205 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-01e72ca8-396c-4aee-8622-31098856bb0b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:40.351299 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-01e72ca8-396c-4aee-8622-31098856bb0b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1698 microversion: 2.1 time: 0.158745 Jul 28 06:45:40.351874 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 560/1126] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:40 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:40.372516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ecfc1b9d-9bfe-4df5-8e3e-1d06c93fd491 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:40.375853 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:40.380096 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ecfc1b9d-9bfe-4df5-8e3e-1d06c93fd491 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:40.380630 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ecfc1b9d-9bfe-4df5-8e3e-1d06c93fd491 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:40.404091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ecfc1b9d-9bfe-4df5-8e3e-1d06c93fd491 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Going to try to start instance {{(pid=124563) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 06:45:40.455833 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ecfc1b9d-9bfe-4df5-8e3e-1d06c93fd491 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/action" status: 202 len: 0 microversion: 2.1 time: 0.086765 Jul 28 06:45:40.456495 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 567/1127] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:45:40 2022] POST /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:45:40.464300 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5cefb271-e091-43de-86b1-e3f27255fe2f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:40.464930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5cefb271-e091-43de-86b1-e3f27255fe2f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:40.471473 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5cefb271-e091-43de-86b1-e3f27255fe2f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:40.471924 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5cefb271-e091-43de-86b1-e3f27255fe2f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:40.472972 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5cefb271-e091-43de-86b1-e3f27255fe2f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:40.473514 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5cefb271-e091-43de-86b1-e3f27255fe2f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:40.605082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5cefb271-e091-43de-86b1-e3f27255fe2f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:40.613443 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5cefb271-e091-43de-86b1-e3f27255fe2f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1707 microversion: 2.1 time: 0.152988 Jul 28 06:45:40.614006 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 561/1128] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:40 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1707 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:40.815003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c6fc3f7c-e550-492d-a60d-f795db0a9a88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:40.815637 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c6fc3f7c-e550-492d-a60d-f795db0a9a88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:40.822474 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6fc3f7c-e550-492d-a60d-f795db0a9a88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:40.822929 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6fc3f7c-e550-492d-a60d-f795db0a9a88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:40.823712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6fc3f7c-e550-492d-a60d-f795db0a9a88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:40.824155 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6fc3f7c-e550-492d-a60d-f795db0a9a88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:41.108361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c6fc3f7c-e550-492d-a60d-f795db0a9a88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:41.116150 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c6fc3f7c-e550-492d-a60d-f795db0a9a88 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.306267 Jul 28 06:45:41.116712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 568/1129] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:40 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:41.635526 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-062b7791-a3ca-4578-964a-4b80c9791d7f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:41.636130 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-062b7791-a3ca-4578-964a-4b80c9791d7f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:41.644074 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-062b7791-a3ca-4578-964a-4b80c9791d7f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:41.644530 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-062b7791-a3ca-4578-964a-4b80c9791d7f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:41.645327 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-062b7791-a3ca-4578-964a-4b80c9791d7f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:41.646002 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-062b7791-a3ca-4578-964a-4b80c9791d7f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:41.781070 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-062b7791-a3ca-4578-964a-4b80c9791d7f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:41.790591 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-062b7791-a3ca-4578-964a-4b80c9791d7f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1707 microversion: 2.1 time: 0.158660 Jul 28 06:45:41.791466 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 562/1130] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:41 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:42.141427 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-60dfbb7c-6f8a-48b3-a5fb-2caa22c19840 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:42.142101 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-60dfbb7c-6f8a-48b3-a5fb-2caa22c19840 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:42.149769 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-60dfbb7c-6f8a-48b3-a5fb-2caa22c19840 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:42.150226 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-60dfbb7c-6f8a-48b3-a5fb-2caa22c19840 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:42.151365 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-60dfbb7c-6f8a-48b3-a5fb-2caa22c19840 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:42.152064 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-60dfbb7c-6f8a-48b3-a5fb-2caa22c19840 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:42.386268 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-60dfbb7c-6f8a-48b3-a5fb-2caa22c19840 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:42.394594 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-60dfbb7c-6f8a-48b3-a5fb-2caa22c19840 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.260078 Jul 28 06:45:42.395168 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 569/1131] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:42 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:42.813929 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f75e8127-2a60-412a-8748-b3025b5cd0de tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:42.814552 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f75e8127-2a60-412a-8748-b3025b5cd0de tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:42.821321 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f75e8127-2a60-412a-8748-b3025b5cd0de tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:42.821764 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f75e8127-2a60-412a-8748-b3025b5cd0de tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:42.822528 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f75e8127-2a60-412a-8748-b3025b5cd0de tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:42.822964 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f75e8127-2a60-412a-8748-b3025b5cd0de tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:43.001066 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f75e8127-2a60-412a-8748-b3025b5cd0de tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:43.009116 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f75e8127-2a60-412a-8748-b3025b5cd0de tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1707 microversion: 2.1 time: 0.199753 Jul 28 06:45:43.009719 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 563/1132] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:42 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1707 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:43.422861 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-33f79f98-ef26-4783-b6c4-17b0b211b2b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:43.423468 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-33f79f98-ef26-4783-b6c4-17b0b211b2b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:43.429933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-33f79f98-ef26-4783-b6c4-17b0b211b2b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:43.430397 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-33f79f98-ef26-4783-b6c4-17b0b211b2b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:43.431157 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-33f79f98-ef26-4783-b6c4-17b0b211b2b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:43.431765 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-33f79f98-ef26-4783-b6c4-17b0b211b2b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:43.600521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-33f79f98-ef26-4783-b6c4-17b0b211b2b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:43.610664 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-33f79f98-ef26-4783-b6c4-17b0b211b2b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.198369 Jul 28 06:45:43.611430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 570/1133] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:43 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:44.031566 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-76fee1a2-9d2d-4301-8c0f-850fdeb711cf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:44.032122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-76fee1a2-9d2d-4301-8c0f-850fdeb711cf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:44.038831 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-76fee1a2-9d2d-4301-8c0f-850fdeb711cf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:44.039286 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-76fee1a2-9d2d-4301-8c0f-850fdeb711cf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:44.040065 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-76fee1a2-9d2d-4301-8c0f-850fdeb711cf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:44.040506 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-76fee1a2-9d2d-4301-8c0f-850fdeb711cf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:44.249752 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-76fee1a2-9d2d-4301-8c0f-850fdeb711cf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:44.258058 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-76fee1a2-9d2d-4301-8c0f-850fdeb711cf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1707 microversion: 2.1 time: 0.231147 Jul 28 06:45:44.259094 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 564/1134] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:44 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1707 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:44.632353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f4ff6901-ded5-4d79-aa1f-28c73c1e607c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:44.632976 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f4ff6901-ded5-4d79-aa1f-28c73c1e607c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:44.640236 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f4ff6901-ded5-4d79-aa1f-28c73c1e607c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:44.640685 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f4ff6901-ded5-4d79-aa1f-28c73c1e607c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:44.641478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f4ff6901-ded5-4d79-aa1f-28c73c1e607c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:44.641927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f4ff6901-ded5-4d79-aa1f-28c73c1e607c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:44.778738 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f4ff6901-ded5-4d79-aa1f-28c73c1e607c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:44.787624 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f4ff6901-ded5-4d79-aa1f-28c73c1e607c tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.159327 Jul 28 06:45:44.788194 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 571/1135] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:44 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:45.279481 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-daa49e94-f375-4704-abdd-f3f2cc9d3f03 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:45.280248 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-daa49e94-f375-4704-abdd-f3f2cc9d3f03 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:45.286507 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-daa49e94-f375-4704-abdd-f3f2cc9d3f03 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:45.287091 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-daa49e94-f375-4704-abdd-f3f2cc9d3f03 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:45.287906 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-daa49e94-f375-4704-abdd-f3f2cc9d3f03 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:45.288411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-daa49e94-f375-4704-abdd-f3f2cc9d3f03 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:45.423723 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-daa49e94-f375-4704-abdd-f3f2cc9d3f03 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:45.431825 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-daa49e94-f375-4704-abdd-f3f2cc9d3f03 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1707 microversion: 2.1 time: 0.156074 Jul 28 06:45:45.432607 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 565/1136] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:45 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:45.808133 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-941ed1cd-8d03-4fb1-bbed-3e39a4d614d0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:45.808862 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-941ed1cd-8d03-4fb1-bbed-3e39a4d614d0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:45.815450 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-941ed1cd-8d03-4fb1-bbed-3e39a4d614d0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:45.816161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-941ed1cd-8d03-4fb1-bbed-3e39a4d614d0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:45.816933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-941ed1cd-8d03-4fb1-bbed-3e39a4d614d0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:45.820270 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-941ed1cd-8d03-4fb1-bbed-3e39a4d614d0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:45.975506 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-941ed1cd-8d03-4fb1-bbed-3e39a4d614d0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:45.987238 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-941ed1cd-8d03-4fb1-bbed-3e39a4d614d0 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.182760 Jul 28 06:45:45.993271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 572/1137] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:45 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:46.454461 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-84467b26-5089-446b-8d2d-0dce3875daa3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:46.455202 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-84467b26-5089-446b-8d2d-0dce3875daa3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:46.461683 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84467b26-5089-446b-8d2d-0dce3875daa3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:46.462136 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84467b26-5089-446b-8d2d-0dce3875daa3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:46.462905 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84467b26-5089-446b-8d2d-0dce3875daa3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:46.463343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-84467b26-5089-446b-8d2d-0dce3875daa3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:46.626576 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-84467b26-5089-446b-8d2d-0dce3875daa3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:46.637583 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-84467b26-5089-446b-8d2d-0dce3875daa3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1707 microversion: 2.1 time: 0.187518 Jul 28 06:45:46.639267 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 566/1138] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:46 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1707 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:47.007868 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f637e213-119c-44e5-9e63-ff5a04bd4ee9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:47.008485 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f637e213-119c-44e5-9e63-ff5a04bd4ee9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:47.015621 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f637e213-119c-44e5-9e63-ff5a04bd4ee9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:47.016083 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f637e213-119c-44e5-9e63-ff5a04bd4ee9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:47.016864 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f637e213-119c-44e5-9e63-ff5a04bd4ee9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:47.017317 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f637e213-119c-44e5-9e63-ff5a04bd4ee9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:47.035231 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:47.158876 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f637e213-119c-44e5-9e63-ff5a04bd4ee9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:47.166179 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f637e213-119c-44e5-9e63-ff5a04bd4ee9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.162192 Jul 28 06:45:47.166852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 573/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:47 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:47.661222 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5c5673d8-bada-4c6e-a417-f0ee2abefaf1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:47.661851 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5c5673d8-bada-4c6e-a417-f0ee2abefaf1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:47.664125 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:45:47.669224 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5c5673d8-bada-4c6e-a417-f0ee2abefaf1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:47.670162 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5c5673d8-bada-4c6e-a417-f0ee2abefaf1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:47.670772 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5c5673d8-bada-4c6e-a417-f0ee2abefaf1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:47.671188 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5c5673d8-bada-4c6e-a417-f0ee2abefaf1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:47.823953 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5c5673d8-bada-4c6e-a417-f0ee2abefaf1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:47.836141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5c5673d8-bada-4c6e-a417-f0ee2abefaf1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1707 microversion: 2.1 time: 0.179187 Jul 28 06:45:47.837007 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 567/1140] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:47 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1707 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:48.188729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-41e2725b-bb07-4f44-9e5c-0bd0e49536a4 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:48.189363 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-41e2725b-bb07-4f44-9e5c-0bd0e49536a4 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:48.196128 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41e2725b-bb07-4f44-9e5c-0bd0e49536a4 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:48.196775 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41e2725b-bb07-4f44-9e5c-0bd0e49536a4 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:48.197555 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41e2725b-bb07-4f44-9e5c-0bd0e49536a4 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:48.197989 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-41e2725b-bb07-4f44-9e5c-0bd0e49536a4 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:48.369035 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-41e2725b-bb07-4f44-9e5c-0bd0e49536a4 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:48.377550 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-41e2725b-bb07-4f44-9e5c-0bd0e49536a4 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.193680 Jul 28 06:45:48.378091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 574/1141] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:48 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:48.859272 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-53a27185-0e31-4e4a-8eda-f3fb1cb0d605 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:48.859887 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-53a27185-0e31-4e4a-8eda-f3fb1cb0d605 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:48.866360 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-53a27185-0e31-4e4a-8eda-f3fb1cb0d605 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:48.866819 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-53a27185-0e31-4e4a-8eda-f3fb1cb0d605 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:48.867588 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-53a27185-0e31-4e4a-8eda-f3fb1cb0d605 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:48.868026 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-53a27185-0e31-4e4a-8eda-f3fb1cb0d605 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:49.006992 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-53a27185-0e31-4e4a-8eda-f3fb1cb0d605 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:49.015053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-53a27185-0e31-4e4a-8eda-f3fb1cb0d605 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1711 microversion: 2.1 time: 0.160300 Jul 28 06:45:49.015624 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 568/1142] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:48 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:49.398692 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ce1f261c-9ba2-4ce1-838c-1aad3a8c39bd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:49.399392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ce1f261c-9ba2-4ce1-838c-1aad3a8c39bd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:49.427147 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce1f261c-9ba2-4ce1-838c-1aad3a8c39bd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:49.427597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce1f261c-9ba2-4ce1-838c-1aad3a8c39bd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:49.428366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce1f261c-9ba2-4ce1-838c-1aad3a8c39bd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:49.428975 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ce1f261c-9ba2-4ce1-838c-1aad3a8c39bd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:49.598271 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-cbd33ef6-ac73-4ce1-9931-f2e5987129c1 req-8e987782-e60d-4e35-afe0-c6aa366fad75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c7a397-7e30-4f41-aa11-751a55aed898", "name": "network-vif-plugged", "status": "completed", "tag": "32380163-a382-4b44-b96f-ac530b2c0610"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:49.609739 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ce1f261c-9ba2-4ce1-838c-1aad3a8c39bd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:49.611984 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-cbd33ef6-ac73-4ce1-9931-f2e5987129c1 req-8e987782-e60d-4e35-afe0-c6aa366fad75 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:49.612624 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-cbd33ef6-ac73-4ce1-9931-f2e5987129c1 req-8e987782-e60d-4e35-afe0-c6aa366fad75 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:49.620319 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ce1f261c-9ba2-4ce1-838c-1aad3a8c39bd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.225739 Jul 28 06:45:49.620906 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 575/1143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:49 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:49.629636 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-cbd33ef6-ac73-4ce1-9931-f2e5987129c1 req-8e987782-e60d-4e35-afe0-c6aa366fad75 service nova] Creating event network-vif-plugged:32380163-a382-4b44-b96f-ac530b2c0610 for instance 31c7a397-7e30-4f41-aa11-751a55aed898 on hv-cinder-85060 Jul 28 06:45:49.635467 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-cbd33ef6-ac73-4ce1-9931-f2e5987129c1 req-8e987782-e60d-4e35-afe0-c6aa366fad75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044490 Jul 28 06:45:49.636601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 569/1144] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:45:50.644348 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d12b97b2-7cc5-4251-b31c-8c93061a0b9e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:50.644990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d12b97b2-7cc5-4251-b31c-8c93061a0b9e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:50.651578 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d12b97b2-7cc5-4251-b31c-8c93061a0b9e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:50.652031 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d12b97b2-7cc5-4251-b31c-8c93061a0b9e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:50.652821 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d12b97b2-7cc5-4251-b31c-8c93061a0b9e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:50.653260 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d12b97b2-7cc5-4251-b31c-8c93061a0b9e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:50.792477 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d12b97b2-7cc5-4251-b31c-8c93061a0b9e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:50.800392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d12b97b2-7cc5-4251-b31c-8c93061a0b9e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1266 microversion: 2.1 time: 0.160033 Jul 28 06:45:50.800959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 576/1145] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:50 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:45:51.823276 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2901653c-d0d7-438f-9452-43fc380ee70e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:51.824789 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2901653c-d0d7-438f-9452-43fc380ee70e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:51.832764 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2901653c-d0d7-438f-9452-43fc380ee70e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:51.833563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2901653c-d0d7-438f-9452-43fc380ee70e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:51.834864 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2901653c-d0d7-438f-9452-43fc380ee70e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:51.835474 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2901653c-d0d7-438f-9452-43fc380ee70e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:51.987110 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2901653c-d0d7-438f-9452-43fc380ee70e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:51.994597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2901653c-d0d7-438f-9452-43fc380ee70e tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1453 microversion: 2.1 time: 0.176330 Jul 28 06:45:51.995233 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 570/1146] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:51 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:52.015983 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b1d687f1-9279-49e5-9b93-a273bd99b9b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:45:52.016720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b1d687f1-9279-49e5-9b93-a273bd99b9b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:45:52.023362 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b1d687f1-9279-49e5-9b93-a273bd99b9b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:52.023811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b1d687f1-9279-49e5-9b93-a273bd99b9b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:52.024576 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b1d687f1-9279-49e5-9b93-a273bd99b9b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:52.025008 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b1d687f1-9279-49e5-9b93-a273bd99b9b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:52.178933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b1d687f1-9279-49e5-9b93-a273bd99b9b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:45:52.187188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b1d687f1-9279-49e5-9b93-a273bd99b9b6 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1453 microversion: 2.1 time: 0.175596 Jul 28 06:45:52.187775 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 577/1147] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:45:52 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:45:54.448596 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-33b951f3-92f4-4a3f-bf56-7ac3846682f0 req-182cfc89-e262-4899-8458-b968af8e6f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c7a397-7e30-4f41-aa11-751a55aed898", "tag": "32380163-a382-4b44-b96f-ac530b2c0610"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:45:54.464994 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-33b951f3-92f4-4a3f-bf56-7ac3846682f0 req-182cfc89-e262-4899-8458-b968af8e6f0d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:45:54.469270 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-33b951f3-92f4-4a3f-bf56-7ac3846682f0 req-182cfc89-e262-4899-8458-b968af8e6f0d service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:45:54.502506 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-33b951f3-92f4-4a3f-bf56-7ac3846682f0 req-182cfc89-e262-4899-8458-b968af8e6f0d service nova] Creating event network-changed:32380163-a382-4b44-b96f-ac530b2c0610 for instance 31c7a397-7e30-4f41-aa11-751a55aed898 on hv-cinder-85060 Jul 28 06:45:54.507882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-33b951f3-92f4-4a3f-bf56-7ac3846682f0 req-182cfc89-e262-4899-8458-b968af8e6f0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063107 Jul 28 06:45:54.509048 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 571/1148] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:46:05.746687 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:05.748211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=27 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:05.970773 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4891b9d7-ef05-4e87-a184-a8ef527c0c6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Action: 'create', calling method: .version_select at 0x7f574c0774c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-593095002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEmrISdX4sNC3uBjRlyfYu7ngPJksR8kUSFe0X0q3l6rPjFwpC+YureqkvXMuhsPzCfnuyEo2Abu9OU6uvJ0nFTiLnZA+Zf6PxNp1z9c4Gj1gBOU2X8HcuMyWhd+cswBQ=="}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:46:05.987579 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-4891b9d7-ef05-4e87-a184-a8ef527c0c6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Getting quotas for project e705818597064414b9d882e0dd2071c2. Resources: {'key_pairs'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:46:05.991925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-4891b9d7-ef05-4e87-a184-a8ef527c0c6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Getting quotas for user 52586f7b50964ec7ae104a04e9be3004 and project e705818597064414b9d882e0dd2071c2. Resources: {'key_pairs'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:46:06.018190 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4891b9d7-ef05-4e87-a184-a8ef527c0c6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.276670 Jul 28 06:46:06.018880 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 578/1149] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Jul 28 06:46:05 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:46:27.937212 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=9 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:27.937984 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=60 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:27.943191 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-127389729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-593095002", "security_groups": [{"name": "tempest-secgroup-smoke-1532325270"}], "networks": [{"uuid": "59e65be8-422f-4df3-bc9b-ac95d0e57680"}], "block_device_mapping_v2": [{"uuid": "218d71ab-0639-4977-a43e-d110433bdfc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:46:28.058720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.network.neutron [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] validate_networks() for [('59e65be8-422f-4df3-bc9b-ac95d0e57680', None, None, None, None, None)] {{(pid=124562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:46:28.663329 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Flavor limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:46:28.663973 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Image limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:46:28.664772 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Flavor pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:46:28.665423 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Image pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:46:28.666101 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:46:28.676617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:28.677061 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:28.677886 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:28.678315 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:28.697526 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Getting quotas for project e705818597064414b9d882e0dd2071c2. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:46:28.701434 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Getting quotas for user 52586f7b50964ec7ae104a04e9be3004 and project e705818597064414b9d882e0dd2071c2. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:46:28.757895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Going to run 1 instances... {{(pid=124562) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:46:28.760068 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='218d71ab-0639-4977-a43e-d110433bdfc5',volume_size=None,volume_type=None)] {{(pid=124562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:46:28.898303 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-38b94aba-e0d8-4ed6-9216-4d3808695934 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.962569 Jul 28 06:46:28.899140 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 572/1150] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:46:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:46:28.909723 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-06710da4-e3ae-4d74-9983-63d1e376c30f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:28.910378 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-06710da4-e3ae-4d74-9983-63d1e376c30f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:28.913244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=4 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:28.914245 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:28.973908 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-06710da4-e3ae-4d74-9983-63d1e376c30f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:28.980854 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-06710da4-e3ae-4d74-9983-63d1e376c30f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1087 microversion: 2.1 time: 0.074964 Jul 28 06:46:28.981440 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 579/1151] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:28 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1087 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:30.002445 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-8c2c1798-4f8a-4bef-a58b-f67414362585 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:30.003344 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-8c2c1798-4f8a-4bef-a58b-f67414362585 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:30.010249 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8c2c1798-4f8a-4bef-a58b-f67414362585 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:30.010713 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8c2c1798-4f8a-4bef-a58b-f67414362585 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:30.011523 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8c2c1798-4f8a-4bef-a58b-f67414362585 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:30.011999 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8c2c1798-4f8a-4bef-a58b-f67414362585 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:30.097505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8c2c1798-4f8a-4bef-a58b-f67414362585 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:30.105875 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-8c2c1798-4f8a-4bef-a58b-f67414362585 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1203 microversion: 2.1 time: 0.107631 Jul 28 06:46:30.106450 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 573/1152] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:29 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1203 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:31.127454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2b63b7fa-3d46-4645-8f8d-de4623f32e1a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:31.128013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2b63b7fa-3d46-4645-8f8d-de4623f32e1a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:31.135867 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b63b7fa-3d46-4645-8f8d-de4623f32e1a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:31.136316 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b63b7fa-3d46-4645-8f8d-de4623f32e1a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:31.137080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b63b7fa-3d46-4645-8f8d-de4623f32e1a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:31.137544 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2b63b7fa-3d46-4645-8f8d-de4623f32e1a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:31.293953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2b63b7fa-3d46-4645-8f8d-de4623f32e1a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:31.304476 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2b63b7fa-3d46-4645-8f8d-de4623f32e1a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.180662 Jul 28 06:46:31.305417 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 580/1153] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:31 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:31.468133 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-d504d390-72eb-4f72-bbc1-c71d66cc346b req-81c24a5b-9f5f-4026-a849-9fa40009960a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52742674-b180-42b2-8d0c-76e434454452", "tag": "3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:46:31.483305 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-d504d390-72eb-4f72-bbc1-c71d66cc346b req-81c24a5b-9f5f-4026-a849-9fa40009960a service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:31.483521 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-d504d390-72eb-4f72-bbc1-c71d66cc346b req-81c24a5b-9f5f-4026-a849-9fa40009960a service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:31.497149 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-d504d390-72eb-4f72-bbc1-c71d66cc346b req-81c24a5b-9f5f-4026-a849-9fa40009960a service nova] Creating event network-changed:3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb for instance 52742674-b180-42b2-8d0c-76e434454452 on hv-cinder-85060 Jul 28 06:46:31.502537 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-d504d390-72eb-4f72-bbc1-c71d66cc346b req-81c24a5b-9f5f-4026-a849-9fa40009960a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039815 Jul 28 06:46:31.503229 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 574/1154] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:46:31.755979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e4a13a9d-bf4b-448f-af4a-053e18892af0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:31.756437 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e4a13a9d-bf4b-448f-af4a-053e18892af0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:31.763215 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e4a13a9d-bf4b-448f-af4a-053e18892af0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:31.763744 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e4a13a9d-bf4b-448f-af4a-053e18892af0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:31.764753 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e4a13a9d-bf4b-448f-af4a-053e18892af0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:31.765233 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e4a13a9d-bf4b-448f-af4a-053e18892af0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:31.854799 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-e4a13a9d-bf4b-448f-af4a-053e18892af0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lazy-loading 'services' on Instance uuid 75a696f5-5e72-43ab-ab80-76c7ff3a3266 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:46:31.927811 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e4a13a9d-bf4b-448f-af4a-053e18892af0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/os-volume_attachments/4b735b03-a954-4ec0-a7e5-d91522779a78" status: 202 len: 0 microversion: 2.1 time: 0.176506 Jul 28 06:46:31.928402 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 581/1155] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:46:31 2022] DELETE /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/os-volume_attachments/4b735b03-a954-4ec0-a7e5-d91522779a78 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:46:32.327858 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ef519853-9e01-4ce8-ac7c-779f29e58e5b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:32.328545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-ef519853-9e01-4ce8-ac7c-779f29e58e5b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:32.338424 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ef519853-9e01-4ce8-ac7c-779f29e58e5b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:32.339169 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ef519853-9e01-4ce8-ac7c-779f29e58e5b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:32.340176 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ef519853-9e01-4ce8-ac7c-779f29e58e5b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:32.340931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-ef519853-9e01-4ce8-ac7c-779f29e58e5b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:32.483398 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-ef519853-9e01-4ce8-ac7c-779f29e58e5b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:32.491009 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ef519853-9e01-4ce8-ac7c-779f29e58e5b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.167772 Jul 28 06:46:32.491572 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 575/1156] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:32 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:33.512933 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-803c8d0e-f80c-4364-9ca0-0e3a049ca000 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:33.513684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-803c8d0e-f80c-4364-9ca0-0e3a049ca000 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:33.521098 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-803c8d0e-f80c-4364-9ca0-0e3a049ca000 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:33.521609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-803c8d0e-f80c-4364-9ca0-0e3a049ca000 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:33.522366 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-803c8d0e-f80c-4364-9ca0-0e3a049ca000 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:33.522800 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-803c8d0e-f80c-4364-9ca0-0e3a049ca000 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:33.656662 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-803c8d0e-f80c-4364-9ca0-0e3a049ca000 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:33.665160 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-803c8d0e-f80c-4364-9ca0-0e3a049ca000 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.156400 Jul 28 06:46:33.665752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 582/1157] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:33 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:34.686061 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0d2fe85a-ca02-4944-a4bf-a6b46defc86d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:34.686597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0d2fe85a-ca02-4944-a4bf-a6b46defc86d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:34.694373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0d2fe85a-ca02-4944-a4bf-a6b46defc86d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:34.694823 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0d2fe85a-ca02-4944-a4bf-a6b46defc86d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:34.695587 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0d2fe85a-ca02-4944-a4bf-a6b46defc86d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:34.696022 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0d2fe85a-ca02-4944-a4bf-a6b46defc86d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:34.828549 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-0d2fe85a-ca02-4944-a4bf-a6b46defc86d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:34.836783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0d2fe85a-ca02-4944-a4bf-a6b46defc86d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.154635 Jul 28 06:46:34.837366 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 576/1158] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:34 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:35.857815 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-513b8476-5a04-4587-a5bf-4fed5c992665 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:35.858410 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-513b8476-5a04-4587-a5bf-4fed5c992665 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:35.865658 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-513b8476-5a04-4587-a5bf-4fed5c992665 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:35.866560 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-513b8476-5a04-4587-a5bf-4fed5c992665 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:35.866867 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-513b8476-5a04-4587-a5bf-4fed5c992665 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:35.867308 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-513b8476-5a04-4587-a5bf-4fed5c992665 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:36.002681 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-513b8476-5a04-4587-a5bf-4fed5c992665 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:36.010228 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-513b8476-5a04-4587-a5bf-4fed5c992665 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.156311 Jul 28 06:46:36.010787 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 583/1159] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:35 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:37.031757 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-94d048dd-6977-40cc-ae2a-691b02d17192 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:37.032393 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-94d048dd-6977-40cc-ae2a-691b02d17192 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:37.038976 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-94d048dd-6977-40cc-ae2a-691b02d17192 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:37.039415 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-94d048dd-6977-40cc-ae2a-691b02d17192 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:37.040172 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-94d048dd-6977-40cc-ae2a-691b02d17192 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:37.040601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-94d048dd-6977-40cc-ae2a-691b02d17192 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:37.176604 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-94d048dd-6977-40cc-ae2a-691b02d17192 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:37.183994 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-94d048dd-6977-40cc-ae2a-691b02d17192 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.156190 Jul 28 06:46:37.184553 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 577/1160] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:37 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:37.283357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9b0e3074-9dc4-48b7-b911-3ccd13188f96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:46:37.290964 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9b0e3074-9dc4-48b7-b911-3ccd13188f96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:37.291415 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9b0e3074-9dc4-48b7-b911-3ccd13188f96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:37.313336 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9b0e3074-9dc4-48b7-b911-3ccd13188f96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Going to try to stop instance {{(pid=124563) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 06:46:37.355477 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9b0e3074-9dc4-48b7-b911-3ccd13188f96 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/action" status: 202 len: 0 microversion: 2.1 time: 0.075874 Jul 28 06:46:37.356061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 584/1161] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:46:37 2022] POST /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:46:37.364459 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d0549bce-325a-4af3-b34b-48e2c8bef9c7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:37.365104 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d0549bce-325a-4af3-b34b-48e2c8bef9c7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:37.371172 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0549bce-325a-4af3-b34b-48e2c8bef9c7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:37.371627 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0549bce-325a-4af3-b34b-48e2c8bef9c7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:37.372392 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0549bce-325a-4af3-b34b-48e2c8bef9c7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:37.372829 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0549bce-325a-4af3-b34b-48e2c8bef9c7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:37.502150 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d0549bce-325a-4af3-b34b-48e2c8bef9c7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:37.509565 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d0549bce-325a-4af3-b34b-48e2c8bef9c7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1675 microversion: 2.1 time: 0.149288 Jul 28 06:46:37.510128 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 578/1162] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:37 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:38.204521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-773d69d6-2f5d-405b-9959-c419f9faf612 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:38.205230 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-773d69d6-2f5d-405b-9959-c419f9faf612 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:38.211494 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-773d69d6-2f5d-405b-9959-c419f9faf612 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:38.211943 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-773d69d6-2f5d-405b-9959-c419f9faf612 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:38.212712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-773d69d6-2f5d-405b-9959-c419f9faf612 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:38.213149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-773d69d6-2f5d-405b-9959-c419f9faf612 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:38.347451 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-773d69d6-2f5d-405b-9959-c419f9faf612 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:38.354941 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-773d69d6-2f5d-405b-9959-c419f9faf612 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.154680 Jul 28 06:46:38.355506 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 585/1163] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:38 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:38.531910 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9e0982b1-81b3-4b29-8faa-e07bf96d98f3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:38.532527 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9e0982b1-81b3-4b29-8faa-e07bf96d98f3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:38.539077 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e0982b1-81b3-4b29-8faa-e07bf96d98f3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:38.539531 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e0982b1-81b3-4b29-8faa-e07bf96d98f3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:38.540295 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e0982b1-81b3-4b29-8faa-e07bf96d98f3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:38.540734 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9e0982b1-81b3-4b29-8faa-e07bf96d98f3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:38.670141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9e0982b1-81b3-4b29-8faa-e07bf96d98f3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:38.678442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9e0982b1-81b3-4b29-8faa-e07bf96d98f3 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1675 microversion: 2.1 time: 0.150362 Jul 28 06:46:38.679044 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 579/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:38 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:39.374995 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-b6b93b9e-736c-4fa9-a91e-907e2bccd978 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:39.375528 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-b6b93b9e-736c-4fa9-a91e-907e2bccd978 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:39.377516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:39.383951 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b6b93b9e-736c-4fa9-a91e-907e2bccd978 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:39.384395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b6b93b9e-736c-4fa9-a91e-907e2bccd978 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:39.385150 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b6b93b9e-736c-4fa9-a91e-907e2bccd978 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:39.385601 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-b6b93b9e-736c-4fa9-a91e-907e2bccd978 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:39.520864 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-b6b93b9e-736c-4fa9-a91e-907e2bccd978 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:39.528388 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-b6b93b9e-736c-4fa9-a91e-907e2bccd978 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.157353 Jul 28 06:46:39.528949 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 586/1165] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:39 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:39.700870 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-28ddbb6f-addb-405b-81ac-ff12b8f67928 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:39.701433 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-28ddbb6f-addb-405b-81ac-ff12b8f67928 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:39.703375 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:39.704046 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=6 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:39.713572 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-28ddbb6f-addb-405b-81ac-ff12b8f67928 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:39.713681 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-28ddbb6f-addb-405b-81ac-ff12b8f67928 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:39.714635 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-28ddbb6f-addb-405b-81ac-ff12b8f67928 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:39.715714 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-28ddbb6f-addb-405b-81ac-ff12b8f67928 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:39.856964 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-28ddbb6f-addb-405b-81ac-ff12b8f67928 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:39.865053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-28ddbb6f-addb-405b-81ac-ff12b8f67928 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1675 microversion: 2.1 time: 0.168557 Jul 28 06:46:39.865650 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 580/1166] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:39 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:40.551157 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8ae61a57-8bd3-470e-9f79-721d058cfa2f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:40.551723 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8ae61a57-8bd3-470e-9f79-721d058cfa2f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:40.557974 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ae61a57-8bd3-470e-9f79-721d058cfa2f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:40.558426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ae61a57-8bd3-470e-9f79-721d058cfa2f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:40.559210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ae61a57-8bd3-470e-9f79-721d058cfa2f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:40.559699 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ae61a57-8bd3-470e-9f79-721d058cfa2f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:40.694756 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8ae61a57-8bd3-470e-9f79-721d058cfa2f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:40.702290 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8ae61a57-8bd3-470e-9f79-721d058cfa2f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.157060 Jul 28 06:46:40.703299 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 587/1167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:40 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:40.887103 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cda8b51a-9c9c-4996-9556-013ee04221ff tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:40.887652 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cda8b51a-9c9c-4996-9556-013ee04221ff tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:40.894504 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cda8b51a-9c9c-4996-9556-013ee04221ff tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:40.895122 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cda8b51a-9c9c-4996-9556-013ee04221ff tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:40.895933 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cda8b51a-9c9c-4996-9556-013ee04221ff tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:40.896374 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cda8b51a-9c9c-4996-9556-013ee04221ff tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:41.045463 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-cda8b51a-9c9c-4996-9556-013ee04221ff tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:41.056882 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cda8b51a-9c9c-4996-9556-013ee04221ff tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1675 microversion: 2.1 time: 0.173509 Jul 28 06:46:41.057535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 581/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:40 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:41.726572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-eccdb681-539d-4e44-adbe-2e7f0d3f36f0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:41.727332 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-eccdb681-539d-4e44-adbe-2e7f0d3f36f0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:41.733968 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-eccdb681-539d-4e44-adbe-2e7f0d3f36f0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:41.734490 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-eccdb681-539d-4e44-adbe-2e7f0d3f36f0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:41.735420 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-eccdb681-539d-4e44-adbe-2e7f0d3f36f0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:41.735922 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-eccdb681-539d-4e44-adbe-2e7f0d3f36f0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:41.872787 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-eccdb681-539d-4e44-adbe-2e7f0d3f36f0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:41.881244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-eccdb681-539d-4e44-adbe-2e7f0d3f36f0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.161565 Jul 28 06:46:41.881834 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 588/1169] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:41 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:42.079844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-552702e0-03ab-4a68-86dd-332234ec6e5a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:42.080461 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-552702e0-03ab-4a68-86dd-332234ec6e5a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:42.087119 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-552702e0-03ab-4a68-86dd-332234ec6e5a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:42.087570 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-552702e0-03ab-4a68-86dd-332234ec6e5a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:42.088338 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-552702e0-03ab-4a68-86dd-332234ec6e5a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:42.088778 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-552702e0-03ab-4a68-86dd-332234ec6e5a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:42.221284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-552702e0-03ab-4a68-86dd-332234ec6e5a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:42.229998 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-552702e0-03ab-4a68-86dd-332234ec6e5a tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1675 microversion: 2.1 time: 0.154006 Jul 28 06:46:42.230567 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 582/1170] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:42 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:42.902495 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3dec8b31-70c8-4e3e-bcd8-bc901bc3c64f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:42.903118 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3dec8b31-70c8-4e3e-bcd8-bc901bc3c64f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:42.910446 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dec8b31-70c8-4e3e-bcd8-bc901bc3c64f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:42.911585 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dec8b31-70c8-4e3e-bcd8-bc901bc3c64f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:42.912999 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dec8b31-70c8-4e3e-bcd8-bc901bc3c64f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:42.913460 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3dec8b31-70c8-4e3e-bcd8-bc901bc3c64f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:43.043848 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-3dec8b31-70c8-4e3e-bcd8-bc901bc3c64f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:43.051308 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3dec8b31-70c8-4e3e-bcd8-bc901bc3c64f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.152687 Jul 28 06:46:43.051862 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 589/1171] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:42 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:43.251828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e70df2fb-f9ba-48e5-abd4-df589f9c9403 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:43.252478 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e70df2fb-f9ba-48e5-abd4-df589f9c9403 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:43.259547 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e70df2fb-f9ba-48e5-abd4-df589f9c9403 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:43.260006 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e70df2fb-f9ba-48e5-abd4-df589f9c9403 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:43.260773 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e70df2fb-f9ba-48e5-abd4-df589f9c9403 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:43.261208 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e70df2fb-f9ba-48e5-abd4-df589f9c9403 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:43.395344 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-e70df2fb-f9ba-48e5-abd4-df589f9c9403 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:43.402784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e70df2fb-f9ba-48e5-abd4-df589f9c9403 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1675 microversion: 2.1 time: 0.154798 Jul 28 06:46:43.403343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 583/1172] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:43 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:44.066728 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-2e3067db-18d5-41d4-acd3-cd9a9e86325b req-cb2f00a1-6242-4d60-9421-afa429ca1970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52742674-b180-42b2-8d0c-76e434454452", "name": "network-vif-plugged", "status": "completed", "tag": "3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:46:44.072668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-8294d8f6-be49-4094-a5bd-a8bb05809f62 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:44.073674 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-8294d8f6-be49-4094-a5bd-a8bb05809f62 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:44.077514 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-2e3067db-18d5-41d4-acd3-cd9a9e86325b req-cb2f00a1-6242-4d60-9421-afa429ca1970 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:44.078074 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-2e3067db-18d5-41d4-acd3-cd9a9e86325b req-cb2f00a1-6242-4d60-9421-afa429ca1970 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:44.081089 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8294d8f6-be49-4094-a5bd-a8bb05809f62 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:44.081685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8294d8f6-be49-4094-a5bd-a8bb05809f62 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:44.082365 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8294d8f6-be49-4094-a5bd-a8bb05809f62 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:44.082800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-8294d8f6-be49-4094-a5bd-a8bb05809f62 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:44.092501 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-2e3067db-18d5-41d4-acd3-cd9a9e86325b req-cb2f00a1-6242-4d60-9421-afa429ca1970 service nova] Creating event network-vif-plugged:3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb for instance 52742674-b180-42b2-8d0c-76e434454452 on hv-cinder-85060 Jul 28 06:46:44.098155 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-2e3067db-18d5-41d4-acd3-cd9a9e86325b req-cb2f00a1-6242-4d60-9421-afa429ca1970 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035831 Jul 28 06:46:44.098978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 590/1173] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:46:44.222743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-8294d8f6-be49-4094-a5bd-a8bb05809f62 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:44.230166 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-8294d8f6-be49-4094-a5bd-a8bb05809f62 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.161371 Jul 28 06:46:44.230729 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 584/1174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:44 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:44.424344 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e45c44de-274b-4c0e-bf81-dfb2e83fd09e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:44.426167 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e45c44de-274b-4c0e-bf81-dfb2e83fd09e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:44.432538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e45c44de-274b-4c0e-bf81-dfb2e83fd09e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:44.432986 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e45c44de-274b-4c0e-bf81-dfb2e83fd09e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:44.433935 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e45c44de-274b-4c0e-bf81-dfb2e83fd09e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:44.434370 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e45c44de-274b-4c0e-bf81-dfb2e83fd09e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:44.568778 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e45c44de-274b-4c0e-bf81-dfb2e83fd09e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:44.576496 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e45c44de-274b-4c0e-bf81-dfb2e83fd09e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1675 microversion: 2.1 time: 0.156324 Jul 28 06:46:44.577222 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 591/1175] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:44 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:45.251475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-259831bd-1647-42f1-84bc-cd0915e8ec9c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:45.252117 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-259831bd-1647-42f1-84bc-cd0915e8ec9c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:45.258688 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-259831bd-1647-42f1-84bc-cd0915e8ec9c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:45.259141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-259831bd-1647-42f1-84bc-cd0915e8ec9c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:45.259905 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-259831bd-1647-42f1-84bc-cd0915e8ec9c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:45.260345 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-259831bd-1647-42f1-84bc-cd0915e8ec9c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:45.390807 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-259831bd-1647-42f1-84bc-cd0915e8ec9c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:45.399250 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-259831bd-1647-42f1-84bc-cd0915e8ec9c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1259 microversion: 2.1 time: 0.151655 Jul 28 06:46:45.399825 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 585/1176] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:45 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:45.597734 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-2c6c7956-8a4a-44bb-8397-1e86a27f5067 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:45.598271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-2c6c7956-8a4a-44bb-8397-1e86a27f5067 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:45.604998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2c6c7956-8a4a-44bb-8397-1e86a27f5067 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:45.605479 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2c6c7956-8a4a-44bb-8397-1e86a27f5067 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:45.606237 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2c6c7956-8a4a-44bb-8397-1e86a27f5067 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:45.606667 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-2c6c7956-8a4a-44bb-8397-1e86a27f5067 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:45.744140 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-2c6c7956-8a4a-44bb-8397-1e86a27f5067 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:45.752091 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-2c6c7956-8a4a-44bb-8397-1e86a27f5067 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1675 microversion: 2.1 time: 0.158358 Jul 28 06:46:45.752697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 592/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:45 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:46.420010 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-621c2def-e37f-462b-9516-68a44ad34c68 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:46.420623 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-621c2def-e37f-462b-9516-68a44ad34c68 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:46.427322 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-621c2def-e37f-462b-9516-68a44ad34c68 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:46.427792 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-621c2def-e37f-462b-9516-68a44ad34c68 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:46.428542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-621c2def-e37f-462b-9516-68a44ad34c68 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:46.428972 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-621c2def-e37f-462b-9516-68a44ad34c68 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:46.561156 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-621c2def-e37f-462b-9516-68a44ad34c68 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:46.568916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-621c2def-e37f-462b-9516-68a44ad34c68 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1443 microversion: 2.1 time: 0.152833 Jul 28 06:46:46.569508 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 586/1178] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:46 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:46.589234 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-eccc3a32-ce44-43ee-b253-ae0352e823cd tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:46.589890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-eccc3a32-ce44-43ee-b253-ae0352e823cd tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:46.595885 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-eccc3a32-ce44-43ee-b253-ae0352e823cd tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:46.596333 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-eccc3a32-ce44-43ee-b253-ae0352e823cd tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:46.597097 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-eccc3a32-ce44-43ee-b253-ae0352e823cd tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:46.597574 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-eccc3a32-ce44-43ee-b253-ae0352e823cd tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:46.744349 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-eccc3a32-ce44-43ee-b253-ae0352e823cd tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:46.751997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-eccc3a32-ce44-43ee-b253-ae0352e823cd tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1443 microversion: 2.1 time: 0.166610 Jul 28 06:46:46.752567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 593/1179] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:46 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1443 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:46.774427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-47b78f1b-ac03-49af-93e8-a4db033ac696 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:46.775584 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-47b78f1b-ac03-49af-93e8-a4db033ac696 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:46.781557 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-47b78f1b-ac03-49af-93e8-a4db033ac696 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:46.782075 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-47b78f1b-ac03-49af-93e8-a4db033ac696 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:46.782915 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-47b78f1b-ac03-49af-93e8-a4db033ac696 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:46.783352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-47b78f1b-ac03-49af-93e8-a4db033ac696 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:46.931346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-47b78f1b-ac03-49af-93e8-a4db033ac696 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:46.943129 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-47b78f1b-ac03-49af-93e8-a4db033ac696 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1675 microversion: 2.1 time: 0.173014 Jul 28 06:46:46.945623 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 587/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:46 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:47.965155 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-6a80b465-a624-4566-9339-38c696304bdc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:47.965779 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-6a80b465-a624-4566-9339-38c696304bdc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:47.972544 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6a80b465-a624-4566-9339-38c696304bdc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:47.972918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6a80b465-a624-4566-9339-38c696304bdc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:47.974982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6a80b465-a624-4566-9339-38c696304bdc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:47.975423 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-6a80b465-a624-4566-9339-38c696304bdc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:48.229850 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-6a80b465-a624-4566-9339-38c696304bdc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:48.237530 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-6a80b465-a624-4566-9339-38c696304bdc tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1675 microversion: 2.1 time: 0.276232 Jul 28 06:46:48.238108 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 594/1181] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:47 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1675 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:48.663493 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-703538c8-436f-4e2a-aab5-ac3e624ec3f9 req-b6e60b38-2e49-440f-91bb-1ce766a02ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52742674-b180-42b2-8d0c-76e434454452", "tag": "3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:46:48.673806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-703538c8-436f-4e2a-aab5-ac3e624ec3f9 req-b6e60b38-2e49-440f-91bb-1ce766a02ed3 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:48.674253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-703538c8-436f-4e2a-aab5-ac3e624ec3f9 req-b6e60b38-2e49-440f-91bb-1ce766a02ed3 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:48.686390 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-703538c8-436f-4e2a-aab5-ac3e624ec3f9 req-b6e60b38-2e49-440f-91bb-1ce766a02ed3 service nova] Creating event network-changed:3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb for instance 52742674-b180-42b2-8d0c-76e434454452 on hv-cinder-85060 Jul 28 06:46:48.691568 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-703538c8-436f-4e2a-aab5-ac3e624ec3f9 req-b6e60b38-2e49-440f-91bb-1ce766a02ed3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032011 Jul 28 06:46:48.692973 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 588/1182] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:46:49.260062 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-662d347a-9739-4d93-b4dc-c73fba58ec6f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:49.261470 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-662d347a-9739-4d93-b4dc-c73fba58ec6f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:49.269538 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-662d347a-9739-4d93-b4dc-c73fba58ec6f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:49.271153 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-662d347a-9739-4d93-b4dc-c73fba58ec6f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:49.272245 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-662d347a-9739-4d93-b4dc-c73fba58ec6f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:49.272904 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-662d347a-9739-4d93-b4dc-c73fba58ec6f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:49.293102 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:49.431177 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-662d347a-9739-4d93-b4dc-c73fba58ec6f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:49.439101 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-662d347a-9739-4d93-b4dc-c73fba58ec6f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1652 microversion: 2.1 time: 0.184506 Jul 28 06:46:49.440053 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 595/1183] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:49 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1652 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:49.461977 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-40a588b4-cd6a-4468-ba5e-d95a3a33a785 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:46:49.469373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-40a588b4-cd6a-4468-ba5e-d95a3a33a785 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:49.469905 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-40a588b4-cd6a-4468-ba5e-d95a3a33a785 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:49.532597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-40a588b4-cd6a-4468-ba5e-d95a3a33a785 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Going to try to start instance {{(pid=124562) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 06:46:49.561086 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:46:49.584948 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-40a588b4-cd6a-4468-ba5e-d95a3a33a785 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/action" status: 202 len: 0 microversion: 2.1 time: 0.127445 Jul 28 06:46:49.585874 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 589/1184] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:46:49 2022] POST /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:46:49.593746 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e781dea6-5082-464c-a5a5-c575e1a9df2e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:49.594281 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e781dea6-5082-464c-a5a5-c575e1a9df2e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:49.601342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e781dea6-5082-464c-a5a5-c575e1a9df2e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:49.601793 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e781dea6-5082-464c-a5a5-c575e1a9df2e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:49.602585 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e781dea6-5082-464c-a5a5-c575e1a9df2e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:49.603002 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e781dea6-5082-464c-a5a5-c575e1a9df2e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:49.845037 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e781dea6-5082-464c-a5a5-c575e1a9df2e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:49.861841 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e781dea6-5082-464c-a5a5-c575e1a9df2e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1661 microversion: 2.1 time: 0.271946 Jul 28 06:46:49.862681 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 596/1185] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:49 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1661 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:50.885494 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5297ac38-ba76-4c43-8792-59c179c4a674 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:50.886200 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5297ac38-ba76-4c43-8792-59c179c4a674 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:50.892538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5297ac38-ba76-4c43-8792-59c179c4a674 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:50.892979 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5297ac38-ba76-4c43-8792-59c179c4a674 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:50.893787 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5297ac38-ba76-4c43-8792-59c179c4a674 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:50.894197 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5297ac38-ba76-4c43-8792-59c179c4a674 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:51.034561 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5297ac38-ba76-4c43-8792-59c179c4a674 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:51.043080 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5297ac38-ba76-4c43-8792-59c179c4a674 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1661 microversion: 2.1 time: 0.162504 Jul 28 06:46:51.043670 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 590/1186] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:50 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1661 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:46:52.064051 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c6935cac-554f-40c8-8442-d00db8aa8a9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:46:52.064697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c6935cac-554f-40c8-8442-d00db8aa8a9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:46:52.072081 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6935cac-554f-40c8-8442-d00db8aa8a9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:52.072540 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6935cac-554f-40c8-8442-d00db8aa8a9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:52.073336 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6935cac-554f-40c8-8442-d00db8aa8a9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:46:52.073782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c6935cac-554f-40c8-8442-d00db8aa8a9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:46:52.204997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-c6935cac-554f-40c8-8442-d00db8aa8a9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:46:52.213194 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c6935cac-554f-40c8-8442-d00db8aa8a9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1665 microversion: 2.1 time: 0.152981 Jul 28 06:46:52.213805 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 597/1187] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:46:52 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:47:16.742545 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:47:16.743072 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Thu Jul 28 06:47:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:47:24.522695 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:47:24.523232 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Thu Jul 28 06:47:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:47:32.846265 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bf637027-2f67-4e25-a881-c9ff428b76a7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:32.846953 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bf637027-2f67-4e25-a881-c9ff428b76a7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:32.848847 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:47:32.849576 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=7,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:47:32.854135 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-d3bea24e-85e7-4e99-8dfe-c0365c8935fd req-12b75f50-6cc2-4107-a22a-af6e78f72585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c7a397-7e30-4f41-aa11-751a55aed898", "tag": "32380163-a382-4b44-b96f-ac530b2c0610"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:47:32.858389 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf637027-2f67-4e25-a881-c9ff428b76a7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:32.858944 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf637027-2f67-4e25-a881-c9ff428b76a7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:32.859720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf637027-2f67-4e25-a881-c9ff428b76a7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:32.860150 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf637027-2f67-4e25-a881-c9ff428b76a7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:32.863807 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=40 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:47:32.865127 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=14 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:47:32.870439 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-d3bea24e-85e7-4e99-8dfe-c0365c8935fd req-12b75f50-6cc2-4107-a22a-af6e78f72585 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:32.870981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-d3bea24e-85e7-4e99-8dfe-c0365c8935fd req-12b75f50-6cc2-4107-a22a-af6e78f72585 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:32.888695 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bf637027-2f67-4e25-a881-c9ff428b76a7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:47:32.892031 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-d3bea24e-85e7-4e99-8dfe-c0365c8935fd req-12b75f50-6cc2-4107-a22a-af6e78f72585 service nova] Creating event network-changed:32380163-a382-4b44-b96f-ac530b2c0610 for instance 31c7a397-7e30-4f41-aa11-751a55aed898 on hv-cinder-85060 Jul 28 06:47:32.897464 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-d3bea24e-85e7-4e99-8dfe-c0365c8935fd req-12b75f50-6cc2-4107-a22a-af6e78f72585 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050880 Jul 28 06:47:32.898049 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 598/1188] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:47:32.976785 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bf637027-2f67-4e25-a881-c9ff428b76a7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 204 len: 0 microversion: 2.1 time: 0.133895 Jul 28 06:47:32.977793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 591/1189] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:47:32 2022] DELETE /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:47:32.987851 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-365ef36b-a16a-4a56-9a1d-86fdf54fabdd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:32.988551 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-365ef36b-a16a-4a56-9a1d-86fdf54fabdd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:32.996035 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-365ef36b-a16a-4a56-9a1d-86fdf54fabdd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:32.996481 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-365ef36b-a16a-4a56-9a1d-86fdf54fabdd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:32.997263 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-365ef36b-a16a-4a56-9a1d-86fdf54fabdd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:32.997721 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-365ef36b-a16a-4a56-9a1d-86fdf54fabdd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:33.308090 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-365ef36b-a16a-4a56-9a1d-86fdf54fabdd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:47:33.315972 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-365ef36b-a16a-4a56-9a1d-86fdf54fabdd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1578 microversion: 2.1 time: 0.332771 Jul 28 06:47:33.316545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 599/1190] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:32 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1578 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:47:34.340473 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-6adace84-b417-4b05-9b42-4c51855777b7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:34.341170 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-6adace84-b417-4b05-9b42-4c51855777b7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:34.347592 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6adace84-b417-4b05-9b42-4c51855777b7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:34.348047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6adace84-b417-4b05-9b42-4c51855777b7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:34.348815 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6adace84-b417-4b05-9b42-4c51855777b7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:34.349251 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-6adace84-b417-4b05-9b42-4c51855777b7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:34.544532 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-6adace84-b417-4b05-9b42-4c51855777b7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:47:34.552063 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-6adace84-b417-4b05-9b42-4c51855777b7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1578 microversion: 2.1 time: 0.216472 Jul 28 06:47:34.552623 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 592/1191] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:34 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:47:35.536287 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-6536d284-61cd-4305-a9f3-73ec27da26cb req-421c6840-8c05-4f6b-b8fd-25d6fcebf8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c7a397-7e30-4f41-aa11-751a55aed898", "name": "network-vif-deleted", "tag": "32380163-a382-4b44-b96f-ac530b2c0610"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:47:35.547671 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-6536d284-61cd-4305-a9f3-73ec27da26cb req-421c6840-8c05-4f6b-b8fd-25d6fcebf8ae service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:35.548116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-6536d284-61cd-4305-a9f3-73ec27da26cb req-421c6840-8c05-4f6b-b8fd-25d6fcebf8ae service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:35.560560 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-6536d284-61cd-4305-a9f3-73ec27da26cb req-421c6840-8c05-4f6b-b8fd-25d6fcebf8ae service nova] Creating event network-vif-deleted:32380163-a382-4b44-b96f-ac530b2c0610 for instance 31c7a397-7e30-4f41-aa11-751a55aed898 on hv-cinder-85060 Jul 28 06:47:35.565519 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-6536d284-61cd-4305-a9f3-73ec27da26cb req-421c6840-8c05-4f6b-b8fd-25d6fcebf8ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032647 Jul 28 06:47:35.566288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 600/1192] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:47:35.573938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-01e3f1c7-a598-42fd-a0ed-b9ed66e90b55 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:35.574556 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-01e3f1c7-a598-42fd-a0ed-b9ed66e90b55 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:35.581112 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01e3f1c7-a598-42fd-a0ed-b9ed66e90b55 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:35.581590 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01e3f1c7-a598-42fd-a0ed-b9ed66e90b55 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:35.582353 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01e3f1c7-a598-42fd-a0ed-b9ed66e90b55 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:35.582783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01e3f1c7-a598-42fd-a0ed-b9ed66e90b55 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:35.652843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-01e3f1c7-a598-42fd-a0ed-b9ed66e90b55 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:47:35.660694 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-01e3f1c7-a598-42fd-a0ed-b9ed66e90b55 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 200 len: 1225 microversion: 2.1 time: 0.090821 Jul 28 06:47:35.661254 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 593/1193] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:35 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:47:36.683437 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1476c74e-3f18-4990-bfbb-9b3b581ed148 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:36.684036 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1476c74e-3f18-4990-bfbb-9b3b581ed148 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 31c7a397-7e30-4f41-aa11-751a55aed898] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:36.690565 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1476c74e-3f18-4990-bfbb-9b3b581ed148 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:36.691007 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1476c74e-3f18-4990-bfbb-9b3b581ed148 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:36.691766 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1476c74e-3f18-4990-bfbb-9b3b581ed148 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:36.692195 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1476c74e-3f18-4990-bfbb-9b3b581ed148 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:36.705227 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-1476c74e-3f18-4990-bfbb-9b3b581ed148 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] HTTP exception thrown: Instance 31c7a397-7e30-4f41-aa11-751a55aed898 could not be found. Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1476c74e-3f18-4990-bfbb-9b3b581ed148 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Request method failure captured: Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 HTTP/1.1 Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i727NE_YihrH1h93rv2sYUjSQ_0m676rbIX-7yuYs2YEoxBGgFb8S3pe1_KIKIPaubCDk7S0G_AOryRJkCigRf2neCEWVWK-O5cXxQ2ncj_ILLfozUX794si0Y-Mqpe6hq7n3D1ctO5M-VsaTIuV_wF_b51OCMAFntb2tHnOVEpbQk Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: f16eee0fb716452e8c760a27b5724d91 Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:47:36.706826 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f16eee0fb716452e8c760a27b5724d91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f16eee0fb716452e8c760a27b5724d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f16eee0fb716452e8c760a27b5724d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f16eee0fb716452e8c760a27b5724d91"}]}] Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: f16eee0fb716452e8c760a27b5724d91 Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-TestVolumeBootPattern-281232211-project Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 13ca4be686f84c279f87016c20129833 Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-TestVolumeBootPattern-281232211-project Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 31c7a397-7e30-4f41-aa11-751a55aed898 could not be found. Jul 28 06:47:36.708549 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '31c7a397-7e30-4f41-aa11-751a55aed898'} Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c7a397-7e30-4f41-aa11-751a55aed898 could not be found. Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:47:36.709597 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c7a397-7e30-4f41-aa11-751a55aed898 could not be found. Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c7a397-7e30-4f41-aa11-751a55aed898 could not be found. Jul 28 06:47:36.710955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:36.712149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1476c74e-3f18-4990-bfbb-9b3b581ed148 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Returning 404 to user: Instance 31c7a397-7e30-4f41-aa11-751a55aed898 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:47:36.712149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1476c74e-3f18-4990-bfbb-9b3b581ed148 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898" status: 404 len: 111 microversion: 2.1 time: 0.029584 Jul 28 06:47:36.712149 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 601/1194] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:36 2022] GET /compute/v2.1/servers/31c7a397-7e30-4f41-aa11-751a55aed898 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:47:39.788478 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-e77988e7-5429-4750-b9e5-fd45a1c805a7 req-4d157529-e6f2-4a60-bdff-5879bd716326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4548c35e-a5d9-488d-843e-5e57b93661bd", "tag": "06e6823a-9903-414f-96e4-6652e6ed6b7a"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:47:39.793150 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3bb5c678-f94e-49ad-b108-b229061dcca7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:39.797506 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3bb5c678-f94e-49ad-b108-b229061dcca7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:39.804522 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3bb5c678-f94e-49ad-b108-b229061dcca7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:39.804982 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3bb5c678-f94e-49ad-b108-b229061dcca7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:39.805902 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3bb5c678-f94e-49ad-b108-b229061dcca7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:39.806898 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3bb5c678-f94e-49ad-b108-b229061dcca7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:39.807019 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-e77988e7-5429-4750-b9e5-fd45a1c805a7 req-4d157529-e6f2-4a60-bdff-5879bd716326 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:39.807523 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-e77988e7-5429-4750-b9e5-fd45a1c805a7 req-4d157529-e6f2-4a60-bdff-5879bd716326 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:39.822434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-e77988e7-5429-4750-b9e5-fd45a1c805a7 req-4d157529-e6f2-4a60-bdff-5879bd716326 service nova] Creating event network-changed:06e6823a-9903-414f-96e4-6652e6ed6b7a for instance 4548c35e-a5d9-488d-843e-5e57b93661bd on hv-cinder-85060 Jul 28 06:47:39.827398 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-e77988e7-5429-4750-b9e5-fd45a1c805a7 req-4d157529-e6f2-4a60-bdff-5879bd716326 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042569 Jul 28 06:47:39.828067 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 602/1195] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:47:39.836253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3bb5c678-f94e-49ad-b108-b229061dcca7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:47:39.920475 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3bb5c678-f94e-49ad-b108-b229061dcca7 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 204 len: 0 microversion: 2.1 time: 0.137440 Jul 28 06:47:39.922579 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 594/1196] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:47:39 2022] DELETE /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:47:39.934819 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-14c16387-a795-49f1-ae23-5598a794d131 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:39.935788 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-14c16387-a795-49f1-ae23-5598a794d131 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:39.942777 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-14c16387-a795-49f1-ae23-5598a794d131 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:39.943499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-14c16387-a795-49f1-ae23-5598a794d131 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:39.944359 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-14c16387-a795-49f1-ae23-5598a794d131 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:39.944867 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-14c16387-a795-49f1-ae23-5598a794d131 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:40.081886 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-14c16387-a795-49f1-ae23-5598a794d131 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:47:40.090442 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-14c16387-a795-49f1-ae23-5598a794d131 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1576 microversion: 2.1 time: 0.162449 Jul 28 06:47:40.091014 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 603/1197] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:39 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:47:41.112554 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-786d2fad-73cd-4fb3-8fc2-2df7068db1e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:41.113176 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-786d2fad-73cd-4fb3-8fc2-2df7068db1e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:41.120178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-786d2fad-73cd-4fb3-8fc2-2df7068db1e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:41.120629 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-786d2fad-73cd-4fb3-8fc2-2df7068db1e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:41.121416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-786d2fad-73cd-4fb3-8fc2-2df7068db1e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:41.121850 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-786d2fad-73cd-4fb3-8fc2-2df7068db1e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:41.255484 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-786d2fad-73cd-4fb3-8fc2-2df7068db1e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:47:41.263988 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-786d2fad-73cd-4fb3-8fc2-2df7068db1e8 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1576 microversion: 2.1 time: 0.155748 Jul 28 06:47:41.264549 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 595/1198] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:41 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:47:42.286410 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1f1d9d7c-2db8-4012-b585-2afbba8f062d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:42.287683 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1f1d9d7c-2db8-4012-b585-2afbba8f062d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:42.295066 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1f1d9d7c-2db8-4012-b585-2afbba8f062d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:42.295519 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1f1d9d7c-2db8-4012-b585-2afbba8f062d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:42.296544 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1f1d9d7c-2db8-4012-b585-2afbba8f062d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:42.297353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1f1d9d7c-2db8-4012-b585-2afbba8f062d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:42.445666 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1f1d9d7c-2db8-4012-b585-2afbba8f062d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ca4be686f84c279f87016c20129833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16eee0fb716452e8c760a27b5724d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:47:42.455096 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1f1d9d7c-2db8-4012-b585-2afbba8f062d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 200 len: 1458 microversion: 2.1 time: 0.172096 Jul 28 06:47:42.455210 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 604/1199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:42 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 1458 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:47:42.521736 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-06c066a0-120c-4020-a646-6fb4f72684ad req-253ca19d-96a0-4593-b487-537651731180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4548c35e-a5d9-488d-843e-5e57b93661bd", "name": "network-vif-deleted", "tag": "06e6823a-9903-414f-96e4-6652e6ed6b7a"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:47:42.534185 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-06c066a0-120c-4020-a646-6fb4f72684ad req-253ca19d-96a0-4593-b487-537651731180 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:42.534630 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-06c066a0-120c-4020-a646-6fb4f72684ad req-253ca19d-96a0-4593-b487-537651731180 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:42.547341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-06c066a0-120c-4020-a646-6fb4f72684ad req-253ca19d-96a0-4593-b487-537651731180 service nova] Creating event network-vif-deleted:06e6823a-9903-414f-96e4-6652e6ed6b7a for instance 4548c35e-a5d9-488d-843e-5e57b93661bd on hv-cinder-85060 Jul 28 06:47:42.552574 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-06c066a0-120c-4020-a646-6fb4f72684ad req-253ca19d-96a0-4593-b487-537651731180 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034627 Jul 28 06:47:42.553197 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 596/1200] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:47:43.476339 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dd1d75f1-14a9-4c31-ba81-7a0badab21a9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:43.477084 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-dd1d75f1-14a9-4c31-ba81-7a0badab21a9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: 4548c35e-a5d9-488d-843e-5e57b93661bd] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:43.484545 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd1d75f1-14a9-4c31-ba81-7a0badab21a9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:43.484999 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd1d75f1-14a9-4c31-ba81-7a0badab21a9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:43.485792 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd1d75f1-14a9-4c31-ba81-7a0badab21a9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:43.486241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-dd1d75f1-14a9-4c31-ba81-7a0badab21a9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:43.500606 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-dd1d75f1-14a9-4c31-ba81-7a0badab21a9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] HTTP exception thrown: Instance 4548c35e-a5d9-488d-843e-5e57b93661bd could not be found. Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dd1d75f1-14a9-4c31-ba81-7a0badab21a9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Request method failure captured: Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd HTTP/1.1 Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i727NE_YihrH1h93rv2sYUjSQ_0m676rbIX-7yuYs2YEoxBGgFb8S3pe1_KIKIPaubCDk7S0G_AOryRJkCigRf2neCEWVWK-O5cXxQ2ncj_ILLfozUX794si0Y-Mqpe6hq7n3D1ctO5M-VsaTIuV_wF_b51OCMAFntb2tHnOVEpbQk Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: f16eee0fb716452e8c760a27b5724d91 Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:47:43.502357 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f16eee0fb716452e8c760a27b5724d91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f16eee0fb716452e8c760a27b5724d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f16eee0fb716452e8c760a27b5724d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f16eee0fb716452e8c760a27b5724d91"}]}] Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: f16eee0fb716452e8c760a27b5724d91 Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-TestVolumeBootPattern-281232211-project Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 13ca4be686f84c279f87016c20129833 Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-TestVolumeBootPattern-281232211-project Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 4548c35e-a5d9-488d-843e-5e57b93661bd could not be found. Jul 28 06:47:43.504013 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '4548c35e-a5d9-488d-843e-5e57b93661bd'} Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4548c35e-a5d9-488d-843e-5e57b93661bd could not be found. Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:47:43.505020 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4548c35e-a5d9-488d-843e-5e57b93661bd could not be found. Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4548c35e-a5d9-488d-843e-5e57b93661bd could not be found. Jul 28 06:47:43.506567 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:43.507953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-dd1d75f1-14a9-4c31-ba81-7a0badab21a9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Returning 404 to user: Instance 4548c35e-a5d9-488d-843e-5e57b93661bd could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:47:43.507953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-dd1d75f1-14a9-4c31-ba81-7a0badab21a9 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd" status: 404 len: 111 microversion: 2.1 time: 0.031396 Jul 28 06:47:43.507953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 605/1201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:43 2022] GET /compute/v2.1/servers/4548c35e-a5d9-488d-843e-5e57b93661bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:47:43.960257 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3501e89b-f86c-4bc4-a993-b0c5b336983d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:43.960836 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3501e89b-f86c-4bc4-a993-b0c5b336983d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:43.968093 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3501e89b-f86c-4bc4-a993-b0c5b336983d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:43.968538 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3501e89b-f86c-4bc4-a993-b0c5b336983d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:43.969304 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3501e89b-f86c-4bc4-a993-b0c5b336983d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:43.969753 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3501e89b-f86c-4bc4-a993-b0c5b336983d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:43.983222 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-3501e89b-f86c-4bc4-a993-b0c5b336983d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] HTTP exception thrown: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3501e89b-f86c-4bc4-a993-b0c5b336983d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Request method failure captured: Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e HTTP/1.1 Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4i727NE_YihrH1h93rv2sYUjSQ_0m676rbIX-7yuYs2YEoxBGgFb8S3pe1_KIKIPaubCDk7S0G_AOryRJkCigRf2neCEWVWK-O5cXxQ2ncj_ILLfozUX794si0Y-Mqpe6hq7n3D1ctO5M-VsaTIuV_wF_b51OCMAFntb2tHnOVEpbQk Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: f16eee0fb716452e8c760a27b5724d91 Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:47:43.984843 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f16eee0fb716452e8c760a27b5724d91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f16eee0fb716452e8c760a27b5724d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f16eee0fb716452e8c760a27b5724d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f16eee0fb716452e8c760a27b5724d91"}]}] Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: f16eee0fb716452e8c760a27b5724d91 Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-TestVolumeBootPattern-281232211-project Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 13ca4be686f84c279f87016c20129833 Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-TestVolumeBootPattern-281232211-project Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:47:43.986617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': 'a882b29e-1e41-4e8d-a8ed-7cdd735d175e'} Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:47:43.987783 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:47:43.989358 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:47:43.991154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3501e89b-f86c-4bc4-a993-b0c5b336983d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Returning 404 to user: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:47:43.991154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3501e89b-f86c-4bc4-a993-b0c5b336983d tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 404 len: 111 microversion: 2.1 time: 0.030791 Jul 28 06:47:43.991154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 597/1202] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:47:43 2022] DELETE /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:47:43.994871 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0a5b42ed-326d-476b-8e5c-89574da83523 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:43.995690 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0a5b42ed-326d-476b-8e5c-89574da83523 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] [instance: a882b29e-1e41-4e8d-a8ed-7cdd735d175e] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:44.001681 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a5b42ed-326d-476b-8e5c-89574da83523 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:44.002133 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a5b42ed-326d-476b-8e5c-89574da83523 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:44.002900 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a5b42ed-326d-476b-8e5c-89574da83523 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:44.003343 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0a5b42ed-326d-476b-8e5c-89574da83523 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:44.016739 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-0a5b42ed-326d-476b-8e5c-89574da83523 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] HTTP exception thrown: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0a5b42ed-326d-476b-8e5c-89574da83523 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Request method failure captured: Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e HTTP/1.1 Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4i727NE_YihrH1h93rv2sYUjSQ_0m676rbIX-7yuYs2YEoxBGgFb8S3pe1_KIKIPaubCDk7S0G_AOryRJkCigRf2neCEWVWK-O5cXxQ2ncj_ILLfozUX794si0Y-Mqpe6hq7n3D1ctO5M-VsaTIuV_wF_b51OCMAFntb2tHnOVEpbQk Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: f16eee0fb716452e8c760a27b5724d91 Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:47:44.018395 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f16eee0fb716452e8c760a27b5724d91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f16eee0fb716452e8c760a27b5724d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f16eee0fb716452e8c760a27b5724d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f16eee0fb716452e8c760a27b5724d91"}]}] Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: f16eee0fb716452e8c760a27b5724d91 Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-TestVolumeBootPattern-281232211 Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-TestVolumeBootPattern-281232211-project Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: 13ca4be686f84c279f87016c20129833 Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-TestVolumeBootPattern-281232211-project Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:47:44.019798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': 'a882b29e-1e41-4e8d-a8ed-7cdd735d175e'} Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:47:44.020726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. Jul 28 06:47:44.022211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:47:44.023769 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0a5b42ed-326d-476b-8e5c-89574da83523 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Returning 404 to user: Instance a882b29e-1e41-4e8d-a8ed-7cdd735d175e could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:47:44.023769 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0a5b42ed-326d-476b-8e5c-89574da83523 tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e" status: 404 len: 111 microversion: 2.1 time: 0.028864 Jul 28 06:47:44.023769 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 606/1203] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:43 2022] GET /compute/v2.1/servers/a882b29e-1e41-4e8d-a8ed-7cdd735d175e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:47:45.326047 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-ead06864-f74a-40b6-89c1-a1f4ad26d1bd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] Calling method '.version_select at 0x7f57475399d0>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:45.351522 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-ead06864-f74a-40b6-89c1-a1f4ad26d1bd tempest-TestVolumeBootPattern-281232211 tempest-TestVolumeBootPattern-281232211-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-306828582" status: 202 len: 0 microversion: 2.1 time: 0.029901 Jul 28 06:47:45.352256 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 598/1204] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Jul 28 06:47:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-306828582 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:47:55.427241 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e1dfe21f-0192-4dd8-8abc-38b8e92459ce tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:55.429421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e1dfe21f-0192-4dd8-8abc-38b8e92459ce tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:55.432037 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=18 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:47:55.432732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=30 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:47:55.439018 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e1dfe21f-0192-4dd8-8abc-38b8e92459ce tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:55.439473 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e1dfe21f-0192-4dd8-8abc-38b8e92459ce tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:55.440504 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e1dfe21f-0192-4dd8-8abc-38b8e92459ce tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:55.440945 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e1dfe21f-0192-4dd8-8abc-38b8e92459ce tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:55.471165 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e1dfe21f-0192-4dd8-8abc-38b8e92459ce tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047793 Jul 28 06:47:55.471722 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 607/1205] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:47:55 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:47:55.530496 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:47:55.531231 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:47:55.535651 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d06e5d4c-f69e-44e5-8b45-0db4696c1be2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:55.536428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d06e5d4c-f69e-44e5-8b45-0db4696c1be2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:55.544355 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d06e5d4c-f69e-44e5-8b45-0db4696c1be2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:55.544835 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d06e5d4c-f69e-44e5-8b45-0db4696c1be2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:55.545588 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d06e5d4c-f69e-44e5-8b45-0db4696c1be2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:55.546026 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d06e5d4c-f69e-44e5-8b45-0db4696c1be2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:55.574146 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d06e5d4c-f69e-44e5-8b45-0db4696c1be2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:47:55.645728 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d06e5d4c-f69e-44e5-8b45-0db4696c1be2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 204 len: 0 microversion: 2.1 time: 0.116559 Jul 28 06:47:55.646506 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 599/1206] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:47:55 2022] DELETE /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:47:55.655090 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-4368970d-aa4e-43de-b213-665dc2e837b0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:55.655705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-4368970d-aa4e-43de-b213-665dc2e837b0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:55.661822 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4368970d-aa4e-43de-b213-665dc2e837b0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:55.662213 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4368970d-aa4e-43de-b213-665dc2e837b0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:55.662975 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4368970d-aa4e-43de-b213-665dc2e837b0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:55.663411 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-4368970d-aa4e-43de-b213-665dc2e837b0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:55.796132 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-4368970d-aa4e-43de-b213-665dc2e837b0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:47:55.803786 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-4368970d-aa4e-43de-b213-665dc2e837b0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1671 microversion: 2.1 time: 0.153295 Jul 28 06:47:55.804344 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 608/1207] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:55 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:47:56.826571 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-01874fda-bac7-4805-96f2-49156198ecf9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:56.827290 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-01874fda-bac7-4805-96f2-49156198ecf9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:56.833745 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01874fda-bac7-4805-96f2-49156198ecf9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:56.834199 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01874fda-bac7-4805-96f2-49156198ecf9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:56.834966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01874fda-bac7-4805-96f2-49156198ecf9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:56.835403 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-01874fda-bac7-4805-96f2-49156198ecf9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:56.972584 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-01874fda-bac7-4805-96f2-49156198ecf9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:47:56.980194 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-01874fda-bac7-4805-96f2-49156198ecf9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1671 microversion: 2.1 time: 0.157999 Jul 28 06:47:56.980761 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 600/1208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:56 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:47:58.001430 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-62b32d02-6277-4f0a-8478-186731dd1e0d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:58.002027 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-62b32d02-6277-4f0a-8478-186731dd1e0d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:58.008665 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-62b32d02-6277-4f0a-8478-186731dd1e0d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:58.009055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-62b32d02-6277-4f0a-8478-186731dd1e0d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:58.009851 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-62b32d02-6277-4f0a-8478-186731dd1e0d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:58.010293 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-62b32d02-6277-4f0a-8478-186731dd1e0d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:58.139129 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-62b32d02-6277-4f0a-8478-186731dd1e0d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:47:58.146487 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-62b32d02-6277-4f0a-8478-186731dd1e0d tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1671 microversion: 2.1 time: 0.148976 Jul 28 06:47:58.147040 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 609/1209] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:57 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:47:59.168754 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-30b3bb71-7b17-4d2a-99c4-5fbffe959db7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:47:59.169424 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-30b3bb71-7b17-4d2a-99c4-5fbffe959db7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:47:59.177686 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-30b3bb71-7b17-4d2a-99c4-5fbffe959db7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:59.178328 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-30b3bb71-7b17-4d2a-99c4-5fbffe959db7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:59.178849 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-30b3bb71-7b17-4d2a-99c4-5fbffe959db7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:59.179283 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-30b3bb71-7b17-4d2a-99c4-5fbffe959db7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:59.262106 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-30b3bb71-7b17-4d2a-99c4-5fbffe959db7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:47:59.270902 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-30b3bb71-7b17-4d2a-99c4-5fbffe959db7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 200 len: 1604 microversion: 2.1 time: 0.106721 Jul 28 06:47:59.286503 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 601/1210] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:47:59 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 1604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:47:59.440610 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-0363d437-83d8-4d15-b694-36b294981b73 req-8f21917f-34d8-4278-a811-9010082dd346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a696f5-5e72-43ab-ab80-76c7ff3a3266", "name": "network-vif-deleted", "tag": "310d1b9d-3dfc-4fa0-b2aa-ffd999bcd30b"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:47:59.452205 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-0363d437-83d8-4d15-b694-36b294981b73 req-8f21917f-34d8-4278-a811-9010082dd346 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:47:59.452854 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-0363d437-83d8-4d15-b694-36b294981b73 req-8f21917f-34d8-4278-a811-9010082dd346 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:47:59.464905 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-0363d437-83d8-4d15-b694-36b294981b73 req-8f21917f-34d8-4278-a811-9010082dd346 service nova] Creating event network-vif-deleted:310d1b9d-3dfc-4fa0-b2aa-ffd999bcd30b for instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 on hv-cinder-85060 Jul 28 06:47:59.470588 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-0363d437-83d8-4d15-b694-36b294981b73 req-8f21917f-34d8-4278-a811-9010082dd346 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245104 Jul 28 06:47:59.471433 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 610/1211] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:48:00.293690 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7994be08-a225-4692-89bb-c0bcfded11d9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:00.294412 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7994be08-a225-4692-89bb-c0bcfded11d9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:00.301436 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7994be08-a225-4692-89bb-c0bcfded11d9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:00.301880 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7994be08-a225-4692-89bb-c0bcfded11d9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:00.302640 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7994be08-a225-4692-89bb-c0bcfded11d9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:00.303074 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7994be08-a225-4692-89bb-c0bcfded11d9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:00.317918 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-7994be08-a225-4692-89bb-c0bcfded11d9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] HTTP exception thrown: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7994be08-a225-4692-89bb-c0bcfded11d9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Request method failure captured: Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 HTTP/1.1 Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4jA4_TJKj8TbPC97s8mgpWwsijke7X2ZVfn8MmAHfp5l0LT74TiV-zjnxo2ZMG7Q78w-G5ZluZPD9aqSkeb6HEa5Rq49jRVR6oyGpg__xdsDwMkZRRQZwJix3uVbPR4_shYEsvxfylYrsJCI2VUv7LBJfPvkWhwycOdaGxuXO_3-vHs Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:48:00.319542 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0f65f082a2547f79ac218e318bee171", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}] Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: a87b79d20f0f4194a99fc342c9b14aa2 Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:48:00.321053 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '75a696f5-5e72-43ab-ab80-76c7ff3a3266'} Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:48:00.321990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:48:00.324534 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:48:00.325879 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7994be08-a225-4692-89bb-c0bcfded11d9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Returning 404 to user: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:48:00.325879 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7994be08-a225-4692-89bb-c0bcfded11d9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 404 len: 111 microversion: 2.1 time: 0.031273 Jul 28 06:48:00.325879 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 602/1212] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:00 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:48:00.331781 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e6317474-77e1-4b05-a413-06e8ee932c31 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '.version_select at 0x7f574c00cd30>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:00.351095 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e6317474-77e1-4b05-a413-06e8ee932c31 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43259339" status: 202 len: 0 microversion: 2.1 time: 0.024184 Jul 28 06:48:00.351695 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 611/1213] 10.222.0.20 () {58 vars in 1215 bytes} [Thu Jul 28 06:48:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43259339 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:48:00.978926 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0c81cc94-20ac-44fa-b967-f7e5482d632f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'create', calling method: .version_select at 0x7f574756b430>, body: {"keypair": {"name": "tempest-keypair-2138029297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1FHK7IfByhzK+x5A31StscWxuvBNZrwOVR1BbcciQ41r2Q0KxmT3hM/DtBGlJ8THmcAPNozeq2/LNDmmouh+F+IDreN57fYhqiJVHBs16dw9ALg2Np1JfImZZat3IYDQ=="}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:48:00.995961 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-0c81cc94-20ac-44fa-b967-f7e5482d632f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Getting quotas for project f0f65f082a2547f79ac218e318bee171. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:48:01.000338 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-0c81cc94-20ac-44fa-b967-f7e5482d632f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Getting quotas for user a87b79d20f0f4194a99fc342c9b14aa2 and project f0f65f082a2547f79ac218e318bee171. Resources: {'key_pairs'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:48:01.021219 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0c81cc94-20ac-44fa-b967-f7e5482d632f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046204 Jul 28 06:48:01.021828 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 603/1214] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Jul 28 06:48:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:48:02.322240 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1122488713", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "442c4b1f-6d7c-47a3-b9fa-bb78bfc76a0d"}], "security_groups": [{"name": "tempest-securitygroup--1611178573"}], "key_name": "tempest-keypair-2138029297", "user_data": "}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:48:02.425853 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.network.neutron [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] validate_networks() for [('442c4b1f-6d7c-47a3-b9fa-bb78bfc76a0d', None, None, None, None, None)] {{(pid=124563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:48:02.905989 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Flavor limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:48:02.906445 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Image limits 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:48:02.906921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Flavor pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:48:02.907328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Image pref 0:0:0 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:48:02.907735 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.virt.hardware [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:48:02.916526 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:02.916964 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:02.917790 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:02.918221 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:02.935386 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Getting quotas for project f0f65f082a2547f79ac218e318bee171. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:48:02.939288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.quota [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Getting quotas for user a87b79d20f0f4194a99fc342c9b14aa2 and project f0f65f082a2547f79ac218e318bee171. Resources: {'ram', 'cores', 'instances'} {{(pid=124563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:48:02.951090 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Going to run 1 instances... {{(pid=124563) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:48:02.953419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:48:03.001107 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-77f38d97-41bc-4272-bbf9-3ed683d06e8e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.683681 Jul 28 06:48:03.001924 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 612/1215] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:48:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:48:03.013128 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-837e8f7d-6815-4b09-b78c-0f8a2d8653d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:03.014400 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-837e8f7d-6815-4b09-b78c-0f8a2d8653d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:03.076472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-837e8f7d-6815-4b09-b78c-0f8a2d8653d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:03.083276 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-837e8f7d-6815-4b09-b78c-0f8a2d8653d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1238 microversion: 2.1 time: 0.074634 Jul 28 06:48:03.083844 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 604/1216] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:03 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:04.105696 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1376132d-e34b-4377-a543-7f811c59e966 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:04.106726 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1376132d-e34b-4377-a543-7f811c59e966 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:04.113700 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1376132d-e34b-4377-a543-7f811c59e966 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:04.114205 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1376132d-e34b-4377-a543-7f811c59e966 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:04.115045 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1376132d-e34b-4377-a543-7f811c59e966 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:04.115479 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1376132d-e34b-4377-a543-7f811c59e966 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:04.184047 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1376132d-e34b-4377-a543-7f811c59e966 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:04.192997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1376132d-e34b-4377-a543-7f811c59e966 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1290 microversion: 2.1 time: 0.092788 Jul 28 06:48:04.193603 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 613/1217] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:04 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:05.214208 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d2f1fe87-5b58-4816-885c-8d06d4eaf81b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:05.214870 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d2f1fe87-5b58-4816-885c-8d06d4eaf81b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:05.221420 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe87-5b58-4816-885c-8d06d4eaf81b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:05.221874 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe87-5b58-4816-885c-8d06d4eaf81b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:05.222661 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe87-5b58-4816-885c-8d06d4eaf81b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:05.223154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe87-5b58-4816-885c-8d06d4eaf81b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:05.318511 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d2f1fe87-5b58-4816-885c-8d06d4eaf81b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:05.325946 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d2f1fe87-5b58-4816-885c-8d06d4eaf81b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1296 microversion: 2.1 time: 0.115820 Jul 28 06:48:05.326520 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 605/1218] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:05 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1296 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:06.216067 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-be5f121e-02ee-4b9a-ba1d-257baa68729c req-f6188104-9e4a-42d6-9161-237eb6adbf9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b24ae82-f673-496a-99ba-e3e9e1056cc4", "tag": "09ab977f-ac61-40dc-9c8c-c5bd31cbcbd8"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:48:06.227486 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-be5f121e-02ee-4b9a-ba1d-257baa68729c req-f6188104-9e4a-42d6-9161-237eb6adbf9f service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:06.227948 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-be5f121e-02ee-4b9a-ba1d-257baa68729c req-f6188104-9e4a-42d6-9161-237eb6adbf9f service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:06.246060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-be5f121e-02ee-4b9a-ba1d-257baa68729c req-f6188104-9e4a-42d6-9161-237eb6adbf9f service nova] Creating event network-changed:09ab977f-ac61-40dc-9c8c-c5bd31cbcbd8 for instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 on hv-cinder-85060 Jul 28 06:48:06.251060 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-be5f121e-02ee-4b9a-ba1d-257baa68729c req-f6188104-9e4a-42d6-9161-237eb6adbf9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039370 Jul 28 06:48:06.251664 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 614/1219] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:48:06.347309 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7d5870a9-2165-4903-a0a1-dd63270d03d4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:06.347834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7d5870a9-2165-4903-a0a1-dd63270d03d4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:06.355410 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d5870a9-2165-4903-a0a1-dd63270d03d4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:06.355863 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d5870a9-2165-4903-a0a1-dd63270d03d4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:06.356648 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d5870a9-2165-4903-a0a1-dd63270d03d4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:06.357083 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d5870a9-2165-4903-a0a1-dd63270d03d4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:06.525897 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-7d5870a9-2165-4903-a0a1-dd63270d03d4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:06.533878 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7d5870a9-2165-4903-a0a1-dd63270d03d4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1364 microversion: 2.1 time: 0.190531 Jul 28 06:48:06.534446 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 606/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:06 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:07.555936 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-07f16726-c210-4574-ba58-b8394e4e12d7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:07.556634 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-07f16726-c210-4574-ba58-b8394e4e12d7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:07.563129 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-07f16726-c210-4574-ba58-b8394e4e12d7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:07.563578 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-07f16726-c210-4574-ba58-b8394e4e12d7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:07.564342 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-07f16726-c210-4574-ba58-b8394e4e12d7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:07.564780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-07f16726-c210-4574-ba58-b8394e4e12d7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:07.693513 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-07f16726-c210-4574-ba58-b8394e4e12d7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:07.702127 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-07f16726-c210-4574-ba58-b8394e4e12d7 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1364 microversion: 2.1 time: 0.150887 Jul 28 06:48:07.702696 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 615/1221] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:07 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:08.723687 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2b9dae5b-b49f-448c-84ee-8e93a13ad14f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:08.724298 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2b9dae5b-b49f-448c-84ee-8e93a13ad14f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:08.731520 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2b9dae5b-b49f-448c-84ee-8e93a13ad14f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:08.731964 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2b9dae5b-b49f-448c-84ee-8e93a13ad14f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:08.732720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2b9dae5b-b49f-448c-84ee-8e93a13ad14f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:08.733151 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2b9dae5b-b49f-448c-84ee-8e93a13ad14f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:08.862632 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2b9dae5b-b49f-448c-84ee-8e93a13ad14f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:08.870082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2b9dae5b-b49f-448c-84ee-8e93a13ad14f tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1364 microversion: 2.1 time: 0.150314 Jul 28 06:48:08.870641 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 607/1222] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:08 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:09.890837 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f1f7282a-5e9a-4c93-9ff0-82ce90192d98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:09.891455 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f1f7282a-5e9a-4c93-9ff0-82ce90192d98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:09.898080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f1f7282a-5e9a-4c93-9ff0-82ce90192d98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:09.898541 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f1f7282a-5e9a-4c93-9ff0-82ce90192d98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:09.899310 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f1f7282a-5e9a-4c93-9ff0-82ce90192d98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:09.899753 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f1f7282a-5e9a-4c93-9ff0-82ce90192d98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:10.029641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f1f7282a-5e9a-4c93-9ff0-82ce90192d98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:10.037016 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f1f7282a-5e9a-4c93-9ff0-82ce90192d98 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1364 microversion: 2.1 time: 0.150190 Jul 28 06:48:10.037612 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 616/1223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:09 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:11.058201 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-c313fefb-a071-4efe-89bc-144a6edc3c62 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:11.058758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-c313fefb-a071-4efe-89bc-144a6edc3c62 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:11.065437 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c313fefb-a071-4efe-89bc-144a6edc3c62 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:11.065888 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c313fefb-a071-4efe-89bc-144a6edc3c62 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:11.066649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c313fefb-a071-4efe-89bc-144a6edc3c62 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:11.067082 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-c313fefb-a071-4efe-89bc-144a6edc3c62 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:11.201378 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-c313fefb-a071-4efe-89bc-144a6edc3c62 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:11.208755 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-c313fefb-a071-4efe-89bc-144a6edc3c62 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1364 microversion: 2.1 time: 0.154925 Jul 28 06:48:11.209334 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 608/1224] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:11 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:12.229909 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-40fc8fa0-518a-4cca-b8b3-bb3f141386f9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:12.230528 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-40fc8fa0-518a-4cca-b8b3-bb3f141386f9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:12.236562 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-40fc8fa0-518a-4cca-b8b3-bb3f141386f9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:12.237017 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-40fc8fa0-518a-4cca-b8b3-bb3f141386f9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:12.237806 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-40fc8fa0-518a-4cca-b8b3-bb3f141386f9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:12.238247 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-40fc8fa0-518a-4cca-b8b3-bb3f141386f9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:12.371396 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-40fc8fa0-518a-4cca-b8b3-bb3f141386f9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:12.379291 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-40fc8fa0-518a-4cca-b8b3-bb3f141386f9 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1364 microversion: 2.1 time: 0.153725 Jul 28 06:48:12.379865 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 617/1225] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:12 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:12.662997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-83737872-ed0e-42fe-b47a-37f346855397 req-82be4072-35f3-41c8-8e91-432f26fecd8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b24ae82-f673-496a-99ba-e3e9e1056cc4", "name": "network-vif-plugged", "status": "completed", "tag": "09ab977f-ac61-40dc-9c8c-c5bd31cbcbd8"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:48:12.672616 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-83737872-ed0e-42fe-b47a-37f346855397 req-82be4072-35f3-41c8-8e91-432f26fecd8b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:12.673062 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-83737872-ed0e-42fe-b47a-37f346855397 req-82be4072-35f3-41c8-8e91-432f26fecd8b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:12.684192 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-83737872-ed0e-42fe-b47a-37f346855397 req-82be4072-35f3-41c8-8e91-432f26fecd8b service nova] Creating event network-vif-plugged:09ab977f-ac61-40dc-9c8c-c5bd31cbcbd8 for instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 on hv-cinder-85060 Jul 28 06:48:12.689189 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-83737872-ed0e-42fe-b47a-37f346855397 req-82be4072-35f3-41c8-8e91-432f26fecd8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089828 Jul 28 06:48:12.689809 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 609/1226] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:48:13.400995 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8481e98b-4543-4c0d-b1a2-1b0bd9b8f3be tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:13.401675 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8481e98b-4543-4c0d-b1a2-1b0bd9b8f3be tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:13.403618 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:48:13.404421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=6 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:48:13.411150 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8481e98b-4543-4c0d-b1a2-1b0bd9b8f3be tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:13.411634 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8481e98b-4543-4c0d-b1a2-1b0bd9b8f3be tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:13.412399 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8481e98b-4543-4c0d-b1a2-1b0bd9b8f3be tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:13.412836 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8481e98b-4543-4c0d-b1a2-1b0bd9b8f3be tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:13.544164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8481e98b-4543-4c0d-b1a2-1b0bd9b8f3be tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:13.551521 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8481e98b-4543-4c0d-b1a2-1b0bd9b8f3be tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1364 microversion: 2.1 time: 0.154439 Jul 28 06:48:13.552082 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 618/1227] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:13 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:14.569715 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=6 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:48:14.574634 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-085a1a50-0990-44e4-b972-6fd40b5cca2b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:14.575580 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-085a1a50-0990-44e4-b972-6fd40b5cca2b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:14.582444 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-085a1a50-0990-44e4-b972-6fd40b5cca2b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:14.582901 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-085a1a50-0990-44e4-b972-6fd40b5cca2b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:14.583660 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-085a1a50-0990-44e4-b972-6fd40b5cca2b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:14.584094 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-085a1a50-0990-44e4-b972-6fd40b5cca2b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:14.717963 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-085a1a50-0990-44e4-b972-6fd40b5cca2b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:14.725646 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-085a1a50-0990-44e4-b972-6fd40b5cca2b tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1551 microversion: 2.1 time: 0.157009 Jul 28 06:48:14.726217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 610/1228] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:14 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:14.746398 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5c2e027a-4d67-4e9a-89fc-b42f4d70c9bf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:14.746956 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5c2e027a-4d67-4e9a-89fc-b42f4d70c9bf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:14.753229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5c2e027a-4d67-4e9a-89fc-b42f4d70c9bf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:14.753705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5c2e027a-4d67-4e9a-89fc-b42f4d70c9bf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:14.754454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5c2e027a-4d67-4e9a-89fc-b42f4d70c9bf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:14.754891 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5c2e027a-4d67-4e9a-89fc-b42f4d70c9bf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:14.830866 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5c2e027a-4d67-4e9a-89fc-b42f4d70c9bf tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088466 Jul 28 06:48:14.831447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 619/1229] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Jul 28 06:48:14 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:48:15.813309 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-8ae36da6-9fd2-4744-83cf-464dc0f03de2 req-a40e5a9a-da8d-4e55-94df-48ebbd1fe5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b24ae82-f673-496a-99ba-e3e9e1056cc4", "tag": "09ab977f-ac61-40dc-9c8c-c5bd31cbcbd8"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:48:15.822982 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-8ae36da6-9fd2-4744-83cf-464dc0f03de2 req-a40e5a9a-da8d-4e55-94df-48ebbd1fe5d6 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:15.823458 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-8ae36da6-9fd2-4744-83cf-464dc0f03de2 req-a40e5a9a-da8d-4e55-94df-48ebbd1fe5d6 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:15.834202 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-8ae36da6-9fd2-4744-83cf-464dc0f03de2 req-a40e5a9a-da8d-4e55-94df-48ebbd1fe5d6 service nova] Creating event network-changed:09ab977f-ac61-40dc-9c8c-c5bd31cbcbd8 for instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 on hv-cinder-85060 Jul 28 06:48:15.839531 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-8ae36da6-9fd2-4744-83cf-464dc0f03de2 req-a40e5a9a-da8d-4e55-94df-48ebbd1fe5d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086822 Jul 28 06:48:15.840113 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 611/1230] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:48:51.920387 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:48:51.921163 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=58 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:48:51.925098 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e500f00d-5a94-48c9-9a92-b02a53e6d969 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:51.925628 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e500f00d-5a94-48c9-9a92-b02a53e6d969 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:51.932548 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e500f00d-5a94-48c9-9a92-b02a53e6d969 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:51.932991 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e500f00d-5a94-48c9-9a92-b02a53e6d969 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:51.933852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e500f00d-5a94-48c9-9a92-b02a53e6d969 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:51.934872 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e500f00d-5a94-48c9-9a92-b02a53e6d969 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:51.958473 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e500f00d-5a94-48c9-9a92-b02a53e6d969 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/ips" status: 200 len: 147 microversion: 2.1 time: 0.040067 Jul 28 06:48:51.959036 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 620/1231] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Jul 28 06:48:51 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:48:53.278890 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:48:53.279626 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:48:53.283893 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-7d575225-2430-4c37-92b0-1dd696bfb4f4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "509226db-c367-4204-95be-e7155306529d"}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:48:53.286301 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-7d575225-2430-4c37-92b0-1dd696bfb4f4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:53.294624 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d575225-2430-4c37-92b0-1dd696bfb4f4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:53.295127 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d575225-2430-4c37-92b0-1dd696bfb4f4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:53.295950 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d575225-2430-4c37-92b0-1dd696bfb4f4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:53.296433 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-7d575225-2430-4c37-92b0-1dd696bfb4f4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:53.560291 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-7d575225-2430-4c37-92b0-1dd696bfb4f4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283773 Jul 28 06:48:53.561112 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 612/1232] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:48:53 2022] POST /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:48:53.710798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-a8cbc503-1ed0-4f82-a172-734721074c4b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:48:53.711319 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-a8cbc503-1ed0-4f82-a172-734721074c4b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:53.717859 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a8cbc503-1ed0-4f82-a172-734721074c4b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:53.718312 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a8cbc503-1ed0-4f82-a172-734721074c4b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:53.719080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a8cbc503-1ed0-4f82-a172-734721074c4b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:53.719519 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-a8cbc503-1ed0-4f82-a172-734721074c4b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:53.741749 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-a8cbc503-1ed0-4f82-a172-734721074c4b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lazy-loading 'flavor' on Instance uuid 52742674-b180-42b2-8d0c-76e434454452 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:48:53.821955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-a8cbc503-1ed0-4f82-a172-734721074c4b tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "POST /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452/action" status: 202 len: 0 microversion: 2.1 time: 0.114825 Jul 28 06:48:53.822712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 621/1233] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:48:53 2022] POST /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:48:53.833346 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-06436ed8-b373-4f8c-af53-b7a2948eac6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:53.833912 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-06436ed8-b373-4f8c-af53-b7a2948eac6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:53.840916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-06436ed8-b373-4f8c-af53-b7a2948eac6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:53.841471 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-06436ed8-b373-4f8c-af53-b7a2948eac6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:53.842238 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-06436ed8-b373-4f8c-af53-b7a2948eac6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:53.843359 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-06436ed8-b373-4f8c-af53-b7a2948eac6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:53.979673 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-06436ed8-b373-4f8c-af53-b7a2948eac6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:53.987504 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-06436ed8-b373-4f8c-af53-b7a2948eac6d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.158708 Jul 28 06:48:53.988015 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 613/1234] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:53 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:55.010006 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-efde2129-8feb-42f5-adba-923c4b75579a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:55.010700 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-efde2129-8feb-42f5-adba-923c4b75579a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:55.017024 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-efde2129-8feb-42f5-adba-923c4b75579a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:55.017509 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-efde2129-8feb-42f5-adba-923c4b75579a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:55.018257 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-efde2129-8feb-42f5-adba-923c4b75579a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:55.018685 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-efde2129-8feb-42f5-adba-923c4b75579a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:55.155180 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-efde2129-8feb-42f5-adba-923c4b75579a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:55.162652 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-efde2129-8feb-42f5-adba-923c4b75579a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.157339 Jul 28 06:48:55.163216 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 622/1235] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:55 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:56.184895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f2e7131c-4201-4c89-976d-f07368405d2e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:56.186178 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f2e7131c-4201-4c89-976d-f07368405d2e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:56.192795 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2e7131c-4201-4c89-976d-f07368405d2e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:56.193238 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2e7131c-4201-4c89-976d-f07368405d2e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:56.194019 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2e7131c-4201-4c89-976d-f07368405d2e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:56.194452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f2e7131c-4201-4c89-976d-f07368405d2e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:56.330445 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f2e7131c-4201-4c89-976d-f07368405d2e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:56.338503 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f2e7131c-4201-4c89-976d-f07368405d2e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.157477 Jul 28 06:48:56.339081 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 614/1236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:56 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:57.360535 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-cc66238b-06a5-45a3-93f7-e89b3c442a79 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:57.361143 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-cc66238b-06a5-45a3-93f7-e89b3c442a79 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:57.367927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cc66238b-06a5-45a3-93f7-e89b3c442a79 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:57.368380 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cc66238b-06a5-45a3-93f7-e89b3c442a79 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:57.369142 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cc66238b-06a5-45a3-93f7-e89b3c442a79 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:57.369605 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-cc66238b-06a5-45a3-93f7-e89b3c442a79 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:57.506540 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-cc66238b-06a5-45a3-93f7-e89b3c442a79 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:57.514547 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-cc66238b-06a5-45a3-93f7-e89b3c442a79 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.158586 Jul 28 06:48:57.515103 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 623/1237] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:57 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:58.535784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-39c0241d-a9e7-452b-a3dc-c9078dc932dc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:58.536392 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-39c0241d-a9e7-452b-a3dc-c9078dc932dc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:58.542897 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-39c0241d-a9e7-452b-a3dc-c9078dc932dc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:58.543338 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-39c0241d-a9e7-452b-a3dc-c9078dc932dc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:58.544092 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-39c0241d-a9e7-452b-a3dc-c9078dc932dc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:58.545262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-39c0241d-a9e7-452b-a3dc-c9078dc932dc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:58.676014 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-39c0241d-a9e7-452b-a3dc-c9078dc932dc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:58.683563 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-39c0241d-a9e7-452b-a3dc-c9078dc932dc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.151607 Jul 28 06:48:58.684127 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 615/1238] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:58 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:48:59.706851 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-984a7047-c876-4429-b470-e82f13f6698f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:48:59.707385 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-984a7047-c876-4429-b470-e82f13f6698f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:48:59.714161 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-984a7047-c876-4429-b470-e82f13f6698f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:59.714612 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-984a7047-c876-4429-b470-e82f13f6698f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:59.715373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-984a7047-c876-4429-b470-e82f13f6698f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:48:59.715812 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-984a7047-c876-4429-b470-e82f13f6698f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:48:59.852003 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-984a7047-c876-4429-b470-e82f13f6698f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:48:59.860789 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-984a7047-c876-4429-b470-e82f13f6698f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.157877 Jul 28 06:48:59.861608 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 624/1239] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:48:59 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:00.883286 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b7ff4e5b-cf59-4c73-8122-7595fe28203d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:00.883910 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b7ff4e5b-cf59-4c73-8122-7595fe28203d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:00.891086 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ff4e5b-cf59-4c73-8122-7595fe28203d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:00.891532 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ff4e5b-cf59-4c73-8122-7595fe28203d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:00.892315 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ff4e5b-cf59-4c73-8122-7595fe28203d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:00.892744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b7ff4e5b-cf59-4c73-8122-7595fe28203d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:01.023149 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b7ff4e5b-cf59-4c73-8122-7595fe28203d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:01.030967 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b7ff4e5b-cf59-4c73-8122-7595fe28203d tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.151470 Jul 28 06:49:01.031732 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 616/1240] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:00 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:01.080030 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d5ffcbda-bed4-4478-9b67-425b55a5cf9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:01.082211 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d5ffcbda-bed4-4478-9b67-425b55a5cf9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:01.088673 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d5ffcbda-bed4-4478-9b67-425b55a5cf9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:01.089121 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d5ffcbda-bed4-4478-9b67-425b55a5cf9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:01.089925 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d5ffcbda-bed4-4478-9b67-425b55a5cf9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:01.090373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d5ffcbda-bed4-4478-9b67-425b55a5cf9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:01.119553 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d5ffcbda-bed4-4478-9b67-425b55a5cf9e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Jul 28 06:49:01.120105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 625/1241] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:49:01 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:49:01.131205 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cee8a535-ea39-435e-935b-a8e4cef5c7d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:01.131693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cee8a535-ea39-435e-935b-a8e4cef5c7d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:01.137793 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cee8a535-ea39-435e-935b-a8e4cef5c7d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:01.138175 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cee8a535-ea39-435e-935b-a8e4cef5c7d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:01.139509 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cee8a535-ea39-435e-935b-a8e4cef5c7d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:01.140081 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cee8a535-ea39-435e-935b-a8e4cef5c7d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:01.167731 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cee8a535-ea39-435e-935b-a8e4cef5c7d5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments/509226db-c367-4204-95be-e7155306529d" status: 200 len: 194 microversion: 2.1 time: 0.040454 Jul 28 06:49:01.168298 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 617/1242] 10.222.0.20 () {58 vars in 1413 bytes} [Thu Jul 28 06:49:01 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments/509226db-c367-4204-95be-e7155306529d => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:49:02.052044 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-1e46a8e7-0ad1-451f-a711-bdc200766465 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:02.052572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-1e46a8e7-0ad1-451f-a711-bdc200766465 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:02.058683 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e46a8e7-0ad1-451f-a711-bdc200766465 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:02.059136 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e46a8e7-0ad1-451f-a711-bdc200766465 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:02.059902 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e46a8e7-0ad1-451f-a711-bdc200766465 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:02.060347 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-1e46a8e7-0ad1-451f-a711-bdc200766465 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:02.445341 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-1e46a8e7-0ad1-451f-a711-bdc200766465 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:02.455206 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-1e46a8e7-0ad1-451f-a711-bdc200766465 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.407010 Jul 28 06:49:02.455795 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 626/1243] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:02 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:02.502176 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0254125d-ea84-4716-ad7c-13412f1c22c8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ef5be60-3bf0-4b43-9cd2-ec68bffb43fc"}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:49:02.504938 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-0254125d-ea84-4716-ad7c-13412f1c22c8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:02.511328 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0254125d-ea84-4716-ad7c-13412f1c22c8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:02.511772 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0254125d-ea84-4716-ad7c-13412f1c22c8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:02.512529 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0254125d-ea84-4716-ad7c-13412f1c22c8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:02.512958 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-0254125d-ea84-4716-ad7c-13412f1c22c8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:02.777974 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0254125d-ea84-4716-ad7c-13412f1c22c8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "POST /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280133 Jul 28 06:49:02.778592 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 618/1244] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Jul 28 06:49:02 2022] POST /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:49:03.477185 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-e9990745-09d9-4a1f-87f4-97af3be713ed tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:03.477839 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-e9990745-09d9-4a1f-87f4-97af3be713ed tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:03.485988 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e9990745-09d9-4a1f-87f4-97af3be713ed tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:03.486444 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e9990745-09d9-4a1f-87f4-97af3be713ed tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:03.487328 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e9990745-09d9-4a1f-87f4-97af3be713ed tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:03.487808 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-e9990745-09d9-4a1f-87f4-97af3be713ed tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:03.617955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-e9990745-09d9-4a1f-87f4-97af3be713ed tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:03.625539 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-e9990745-09d9-4a1f-87f4-97af3be713ed tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.152359 Jul 28 06:49:03.626104 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 627/1245] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:03 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:04.648427 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-56be9864-4606-4662-81de-6099410fdae4 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:04.649155 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-56be9864-4606-4662-81de-6099410fdae4 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:04.655924 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56be9864-4606-4662-81de-6099410fdae4 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:04.656370 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56be9864-4606-4662-81de-6099410fdae4 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:04.657137 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56be9864-4606-4662-81de-6099410fdae4 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:04.657612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-56be9864-4606-4662-81de-6099410fdae4 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:04.826272 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-56be9864-4606-4662-81de-6099410fdae4 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:04.833806 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-56be9864-4606-4662-81de-6099410fdae4 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.190159 Jul 28 06:49:04.834379 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 619/1246] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:04 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:05.855511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-d3cee841-a08e-4040-8a10-4172652c3a1f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:05.856116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-d3cee841-a08e-4040-8a10-4172652c3a1f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:05.862665 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3cee841-a08e-4040-8a10-4172652c3a1f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:05.863107 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3cee841-a08e-4040-8a10-4172652c3a1f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:05.863859 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3cee841-a08e-4040-8a10-4172652c3a1f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:05.864290 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-d3cee841-a08e-4040-8a10-4172652c3a1f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:06.001169 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-d3cee841-a08e-4040-8a10-4172652c3a1f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:06.008768 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-d3cee841-a08e-4040-8a10-4172652c3a1f tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.157045 Jul 28 06:49:06.009335 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 628/1247] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:05 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:06.549613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:49:06.550142 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Thu Jul 28 06:49:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:49:07.031549 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bf8c3ab2-89a2-4112-bbbf-0be7032797fb tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:07.032484 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bf8c3ab2-89a2-4112-bbbf-0be7032797fb tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:07.039967 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf8c3ab2-89a2-4112-bbbf-0be7032797fb tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:07.040425 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf8c3ab2-89a2-4112-bbbf-0be7032797fb tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:07.041391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf8c3ab2-89a2-4112-bbbf-0be7032797fb tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:07.041784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bf8c3ab2-89a2-4112-bbbf-0be7032797fb tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:07.184425 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bf8c3ab2-89a2-4112-bbbf-0be7032797fb tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:07.194662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bf8c3ab2-89a2-4112-bbbf-0be7032797fb tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.167844 Jul 28 06:49:07.205091 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 620/1248] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:07 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:08.216202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f5b26804-2c54-411f-b978-455205aeab85 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:08.217571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f5b26804-2c54-411f-b978-455205aeab85 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:08.224089 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f5b26804-2c54-411f-b978-455205aeab85 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:08.224534 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f5b26804-2c54-411f-b978-455205aeab85 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:08.225321 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f5b26804-2c54-411f-b978-455205aeab85 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:08.225756 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f5b26804-2c54-411f-b978-455205aeab85 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:08.354979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f5b26804-2c54-411f-b978-455205aeab85 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:08.363936 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f5b26804-2c54-411f-b978-455205aeab85 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1509 microversion: 2.1 time: 0.151480 Jul 28 06:49:08.364500 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 629/1249] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:08 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:08.385367 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a0bc04fd-a835-4a24-8e03-55a34a4b61d6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:49:08.385971 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a0bc04fd-a835-4a24-8e03-55a34a4b61d6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:08.392451 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0bc04fd-a835-4a24-8e03-55a34a4b61d6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:08.392904 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0bc04fd-a835-4a24-8e03-55a34a4b61d6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:08.393732 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0bc04fd-a835-4a24-8e03-55a34a4b61d6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:08.394170 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a0bc04fd-a835-4a24-8e03-55a34a4b61d6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:08.443207 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a0bc04fd-a835-4a24-8e03-55a34a4b61d6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124562) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 06:49:08.510896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a0bc04fd-a835-4a24-8e03-55a34a4b61d6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "POST /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452/action" status: 202 len: 0 microversion: 2.1 time: 0.128320 Jul 28 06:49:08.510896 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 621/1250] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Jul 28 06:49:08 2022] POST /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:49:08.518963 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8ef85cda-2b00-4793-97aa-f00652345dfc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:08.519574 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8ef85cda-2b00-4793-97aa-f00652345dfc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:08.525576 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ef85cda-2b00-4793-97aa-f00652345dfc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:08.526025 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ef85cda-2b00-4793-97aa-f00652345dfc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:08.526795 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ef85cda-2b00-4793-97aa-f00652345dfc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:08.527231 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8ef85cda-2b00-4793-97aa-f00652345dfc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:08.669381 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8ef85cda-2b00-4793-97aa-f00652345dfc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:08.678407 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8ef85cda-2b00-4793-97aa-f00652345dfc tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1517 microversion: 2.1 time: 0.163275 Jul 28 06:49:08.679057 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 630/1251] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:08 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:09.700394 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-b0e46710-8d09-4b5e-b53c-5f74e49f8b18 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:09.702028 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-b0e46710-8d09-4b5e-b53c-5f74e49f8b18 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:09.708804 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0e46710-8d09-4b5e-b53c-5f74e49f8b18 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:09.709816 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0e46710-8d09-4b5e-b53c-5f74e49f8b18 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:09.710588 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0e46710-8d09-4b5e-b53c-5f74e49f8b18 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:09.711297 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-b0e46710-8d09-4b5e-b53c-5f74e49f8b18 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:09.855720 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-b0e46710-8d09-4b5e-b53c-5f74e49f8b18 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:09.863314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-b0e46710-8d09-4b5e-b53c-5f74e49f8b18 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1519 microversion: 2.1 time: 0.167326 Jul 28 06:49:09.863876 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 622/1252] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:09 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:10.410391 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-3f28a0ae-dbef-4cbd-8b5c-10c804bac6c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:10.412560 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-3f28a0ae-dbef-4cbd-8b5c-10c804bac6c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:10.418809 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3f28a0ae-dbef-4cbd-8b5c-10c804bac6c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:10.419264 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3f28a0ae-dbef-4cbd-8b5c-10c804bac6c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:10.420543 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3f28a0ae-dbef-4cbd-8b5c-10c804bac6c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:10.420977 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-3f28a0ae-dbef-4cbd-8b5c-10c804bac6c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:10.453271 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-3f28a0ae-dbef-4cbd-8b5c-10c804bac6c2 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046861 Jul 28 06:49:10.453985 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 631/1253] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:49:10 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:49:10.604299 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-3cd9a0c7-23ec-4f63-ae8b-12fd377bd069 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:10.604694 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-3cd9a0c7-23ec-4f63-ae8b-12fd377bd069 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:10.611460 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3cd9a0c7-23ec-4f63-ae8b-12fd377bd069 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:10.612137 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3cd9a0c7-23ec-4f63-ae8b-12fd377bd069 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:10.612916 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3cd9a0c7-23ec-4f63-ae8b-12fd377bd069 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:10.613386 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-3cd9a0c7-23ec-4f63-ae8b-12fd377bd069 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:10.642954 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-3cd9a0c7-23ec-4f63-ae8b-12fd377bd069 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments/509226db-c367-4204-95be-e7155306529d" status: 200 len: 194 microversion: 2.1 time: 0.043118 Jul 28 06:49:10.643892 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 623/1254] 10.222.0.20 () {58 vars in 1413 bytes} [Thu Jul 28 06:49:10 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments/509226db-c367-4204-95be-e7155306529d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:49:10.654815 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-407c8e48-a9a0-4b4d-a9f7-8e1d84e521f5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:10.655404 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-407c8e48-a9a0-4b4d-a9f7-8e1d84e521f5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:10.661694 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-407c8e48-a9a0-4b4d-a9f7-8e1d84e521f5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:10.662055 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-407c8e48-a9a0-4b4d-a9f7-8e1d84e521f5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:10.662896 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-407c8e48-a9a0-4b4d-a9f7-8e1d84e521f5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:10.663419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-407c8e48-a9a0-4b4d-a9f7-8e1d84e521f5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:10.719420 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-8c54d92a-3d69-43d6-81c0-7e81195ae5fc req-84708a21-3a8e-479f-918c-bf2487d2631b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52742674-b180-42b2-8d0c-76e434454452", "name": "network-vif-unplugged", "status": "completed", "tag": "3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:49:10.731891 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-8c54d92a-3d69-43d6-81c0-7e81195ae5fc req-84708a21-3a8e-479f-918c-bf2487d2631b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:10.733417 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-8c54d92a-3d69-43d6-81c0-7e81195ae5fc req-84708a21-3a8e-479f-918c-bf2487d2631b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:10.745632 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-8c54d92a-3d69-43d6-81c0-7e81195ae5fc req-84708a21-3a8e-479f-918c-bf2487d2631b service nova] Creating event network-vif-unplugged:3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb for instance 52742674-b180-42b2-8d0c-76e434454452 on hv-cinder-85060 Jul 28 06:49:10.751966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-8c54d92a-3d69-43d6-81c0-7e81195ae5fc req-84708a21-3a8e-479f-918c-bf2487d2631b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036628 Jul 28 06:49:10.753017 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 624/1255] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:49:10.754452 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-407c8e48-a9a0-4b4d-a9f7-8e1d84e521f5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lazy-loading 'services' on Instance uuid 3b24ae82-f673-496a-99ba-e3e9e1056cc4 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:49:10.828656 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-407c8e48-a9a0-4b4d-a9f7-8e1d84e521f5 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments/509226db-c367-4204-95be-e7155306529d" status: 202 len: 0 microversion: 2.1 time: 0.177803 Jul 28 06:49:10.829356 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 632/1256] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:49:10 2022] DELETE /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments/509226db-c367-4204-95be-e7155306529d => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:49:10.884325 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-645f99c1-6d9f-40f8-91b2-4b52ad20abe9 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:10.885013 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-645f99c1-6d9f-40f8-91b2-4b52ad20abe9 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:10.892171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-645f99c1-6d9f-40f8-91b2-4b52ad20abe9 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:10.892609 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-645f99c1-6d9f-40f8-91b2-4b52ad20abe9 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:10.893385 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-645f99c1-6d9f-40f8-91b2-4b52ad20abe9 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:10.893811 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-645f99c1-6d9f-40f8-91b2-4b52ad20abe9 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:10.911947 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:49:11.063782 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-645f99c1-6d9f-40f8-91b2-4b52ad20abe9 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:11.071526 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-645f99c1-6d9f-40f8-91b2-4b52ad20abe9 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.191379 Jul 28 06:49:11.072119 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 625/1257] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:10 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:12.094967 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-55ef4cd6-4c71-4720-a9ba-041fb127d7e5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:12.095780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-55ef4cd6-4c71-4720-a9ba-041fb127d7e5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:12.103329 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-55ef4cd6-4c71-4720-a9ba-041fb127d7e5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:12.103862 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-55ef4cd6-4c71-4720-a9ba-041fb127d7e5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:12.104703 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-55ef4cd6-4c71-4720-a9ba-041fb127d7e5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:12.105212 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-55ef4cd6-4c71-4720-a9ba-041fb127d7e5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:12.238154 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-55ef4cd6-4c71-4720-a9ba-041fb127d7e5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:12.245578 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-55ef4cd6-4c71-4720-a9ba-041fb127d7e5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.155547 Jul 28 06:49:12.246148 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 633/1258] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:12 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:13.005758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-a3e9d87a-1096-4c87-973b-4aefe52036b6 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:13.006262 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-a3e9d87a-1096-4c87-973b-4aefe52036b6 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:13.012713 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3e9d87a-1096-4c87-973b-4aefe52036b6 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:13.013815 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3e9d87a-1096-4c87-973b-4aefe52036b6 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:13.014586 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3e9d87a-1096-4c87-973b-4aefe52036b6 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:13.015021 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-a3e9d87a-1096-4c87-973b-4aefe52036b6 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:13.042833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-a3e9d87a-1096-4c87-973b-4aefe52036b6 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments/7ef5be60-3bf0-4b43-9cd2-ec68bffb43fc" status: 200 len: 194 microversion: 2.1 time: 0.040991 Jul 28 06:49:13.043401 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 626/1259] 10.222.0.20 () {58 vars in 1413 bytes} [Thu Jul 28 06:49:13 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments/7ef5be60-3bf0-4b43-9cd2-ec68bffb43fc => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:49:13.053737 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-88a306c4-58ea-47d9-b6f2-4b3593a52fc4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:13.054232 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-88a306c4-58ea-47d9-b6f2-4b3593a52fc4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:13.060725 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-88a306c4-58ea-47d9-b6f2-4b3593a52fc4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:13.061174 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-88a306c4-58ea-47d9-b6f2-4b3593a52fc4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:13.061959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-88a306c4-58ea-47d9-b6f2-4b3593a52fc4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:13.062392 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-88a306c4-58ea-47d9-b6f2-4b3593a52fc4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:13.066596 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:49:13.144108 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-88a306c4-58ea-47d9-b6f2-4b3593a52fc4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lazy-loading 'services' on Instance uuid 3b24ae82-f673-496a-99ba-e3e9e1056cc4 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:49:13.216133 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-88a306c4-58ea-47d9-b6f2-4b3593a52fc4 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments/7ef5be60-3bf0-4b43-9cd2-ec68bffb43fc" status: 202 len: 0 microversion: 2.1 time: 0.166146 Jul 28 06:49:13.216770 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 634/1260] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Jul 28 06:49:13 2022] DELETE /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments/7ef5be60-3bf0-4b43-9cd2-ec68bffb43fc => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:49:13.268860 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f542483b-a87a-40c4-85ea-3c5f1cd7adc2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:13.273411 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f542483b-a87a-40c4-85ea-3c5f1cd7adc2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:13.280850 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f542483b-a87a-40c4-85ea-3c5f1cd7adc2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:13.281476 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f542483b-a87a-40c4-85ea-3c5f1cd7adc2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:13.282291 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f542483b-a87a-40c4-85ea-3c5f1cd7adc2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:13.282728 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f542483b-a87a-40c4-85ea-3c5f1cd7adc2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:13.417743 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f542483b-a87a-40c4-85ea-3c5f1cd7adc2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:13.425947 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f542483b-a87a-40c4-85ea-3c5f1cd7adc2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.162432 Jul 28 06:49:13.426514 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 627/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:13 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:14.396278 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-c1847345-1f35-4483-b0da-0d4ec886d757 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:14.398684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-c1847345-1f35-4483-b0da-0d4ec886d757 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:14.405608 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c1847345-1f35-4483-b0da-0d4ec886d757 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:14.406061 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c1847345-1f35-4483-b0da-0d4ec886d757 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:14.406819 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c1847345-1f35-4483-b0da-0d4ec886d757 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:14.407254 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-c1847345-1f35-4483-b0da-0d4ec886d757 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:14.436556 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-c1847345-1f35-4483-b0da-0d4ec886d757 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044526 Jul 28 06:49:14.437118 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 635/1262] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:49:14 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:49:14.447713 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-09a4a0f7-3658-4dae-b2dc-58c79d25e95a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:14.448418 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-09a4a0f7-3658-4dae-b2dc-58c79d25e95a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:14.456087 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-09a4a0f7-3658-4dae-b2dc-58c79d25e95a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:14.456539 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-09a4a0f7-3658-4dae-b2dc-58c79d25e95a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:14.457338 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-09a4a0f7-3658-4dae-b2dc-58c79d25e95a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:14.457784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-09a4a0f7-3658-4dae-b2dc-58c79d25e95a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:14.550338 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-0ab8ea64-bda9-48a9-94fa-a490443dba08 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:14.552613 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-0ab8ea64-bda9-48a9-94fa-a490443dba08 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:14.558753 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0ab8ea64-bda9-48a9-94fa-a490443dba08 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:14.559204 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0ab8ea64-bda9-48a9-94fa-a490443dba08 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:14.559980 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0ab8ea64-bda9-48a9-94fa-a490443dba08 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:14.560415 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-0ab8ea64-bda9-48a9-94fa-a490443dba08 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:14.588997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-0ab8ea64-bda9-48a9-94fa-a490443dba08 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042285 Jul 28 06:49:14.589684 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 636/1263] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Jul 28 06:49:14 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 06:49:14.593089 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-09a4a0f7-3658-4dae-b2dc-58c79d25e95a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:14.600799 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-09a4a0f7-3658-4dae-b2dc-58c79d25e95a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.156825 Jul 28 06:49:14.601397 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 628/1264] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:14 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:14.662511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ef1244ac-55e3-4854-a5cf-999dc357dc32 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:14.663043 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ef1244ac-55e3-4854-a5cf-999dc357dc32 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:14.669239 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ef1244ac-55e3-4854-a5cf-999dc357dc32 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:14.670293 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ef1244ac-55e3-4854-a5cf-999dc357dc32 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:14.671064 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ef1244ac-55e3-4854-a5cf-999dc357dc32 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:14.671503 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ef1244ac-55e3-4854-a5cf-999dc357dc32 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:14.697256 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ef1244ac-55e3-4854-a5cf-999dc357dc32 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Going to try to terminate instance {{(pid=124563) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:49:14.771967 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ef1244ac-55e3-4854-a5cf-999dc357dc32 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 204 len: 0 microversion: 2.1 time: 0.113001 Jul 28 06:49:14.772559 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 637/1265] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:49:14 2022] DELETE /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:49:14.781663 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5151b1ff-bdf8-4bdd-b8a4-f50d738b9317 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:14.782277 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5151b1ff-bdf8-4bdd-b8a4-f50d738b9317 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:14.788337 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5151b1ff-bdf8-4bdd-b8a4-f50d738b9317 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:14.788786 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5151b1ff-bdf8-4bdd-b8a4-f50d738b9317 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:14.789576 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5151b1ff-bdf8-4bdd-b8a4-f50d738b9317 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:14.790012 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5151b1ff-bdf8-4bdd-b8a4-f50d738b9317 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:14.917756 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5151b1ff-bdf8-4bdd-b8a4-f50d738b9317 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:14.927287 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5151b1ff-bdf8-4bdd-b8a4-f50d738b9317 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1676 microversion: 2.1 time: 0.150140 Jul 28 06:49:14.927876 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 629/1266] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:14 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:15.622998 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-7df716c4-6907-4f2b-b211-2cde38abea90 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:15.623729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-7df716c4-6907-4f2b-b211-2cde38abea90 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:15.630171 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7df716c4-6907-4f2b-b211-2cde38abea90 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:15.630637 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7df716c4-6907-4f2b-b211-2cde38abea90 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:15.631413 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7df716c4-6907-4f2b-b211-2cde38abea90 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:15.631849 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-7df716c4-6907-4f2b-b211-2cde38abea90 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:15.775052 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-7df716c4-6907-4f2b-b211-2cde38abea90 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:15.782642 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-7df716c4-6907-4f2b-b211-2cde38abea90 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.164000 Jul 28 06:49:15.783212 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 638/1267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:15 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:15.949456 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-5aff5650-55b0-42cf-8bf4-dcaed9434645 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:15.950061 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-5aff5650-55b0-42cf-8bf4-dcaed9434645 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:15.957190 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5aff5650-55b0-42cf-8bf4-dcaed9434645 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:15.957662 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5aff5650-55b0-42cf-8bf4-dcaed9434645 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:15.958419 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5aff5650-55b0-42cf-8bf4-dcaed9434645 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:15.958854 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-5aff5650-55b0-42cf-8bf4-dcaed9434645 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:16.088747 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-5aff5650-55b0-42cf-8bf4-dcaed9434645 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:16.096141 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-5aff5650-55b0-42cf-8bf4-dcaed9434645 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1676 microversion: 2.1 time: 0.150578 Jul 28 06:49:16.096712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 630/1268] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:15 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:16.805185 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-38b2b62f-c6eb-4756-84d2-f3b69af13705 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:16.805851 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-38b2b62f-c6eb-4756-84d2-f3b69af13705 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:16.812353 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-38b2b62f-c6eb-4756-84d2-f3b69af13705 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:16.812805 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-38b2b62f-c6eb-4756-84d2-f3b69af13705 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:16.813600 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-38b2b62f-c6eb-4756-84d2-f3b69af13705 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:16.814044 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-38b2b62f-c6eb-4756-84d2-f3b69af13705 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:16.943729 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-38b2b62f-c6eb-4756-84d2-f3b69af13705 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:16.951849 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-38b2b62f-c6eb-4756-84d2-f3b69af13705 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.150526 Jul 28 06:49:16.952454 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 639/1269] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:16 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:17.118171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-54c5b6d8-8701-4093-ba7b-30d818bae142 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:17.118696 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-54c5b6d8-8701-4093-ba7b-30d818bae142 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:17.126444 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54c5b6d8-8701-4093-ba7b-30d818bae142 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:17.126901 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54c5b6d8-8701-4093-ba7b-30d818bae142 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:17.127675 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54c5b6d8-8701-4093-ba7b-30d818bae142 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:17.128116 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-54c5b6d8-8701-4093-ba7b-30d818bae142 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:17.351668 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-54c5b6d8-8701-4093-ba7b-30d818bae142 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:17.360928 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-54c5b6d8-8701-4093-ba7b-30d818bae142 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1676 microversion: 2.1 time: 0.246673 Jul 28 06:49:17.361540 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 631/1270] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:17 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:17.934457 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-67d2bd06-5fa1-4610-ba47-05d2744280d5 req-d3d79932-ce1c-46e6-8086-d9edb98ca651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b24ae82-f673-496a-99ba-e3e9e1056cc4", "name": "network-vif-deleted", "tag": "09ab977f-ac61-40dc-9c8c-c5bd31cbcbd8"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:49:17.945334 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-67d2bd06-5fa1-4610-ba47-05d2744280d5 req-d3d79932-ce1c-46e6-8086-d9edb98ca651 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:17.945791 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-67d2bd06-5fa1-4610-ba47-05d2744280d5 req-d3d79932-ce1c-46e6-8086-d9edb98ca651 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:17.957117 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-67d2bd06-5fa1-4610-ba47-05d2744280d5 req-d3d79932-ce1c-46e6-8086-d9edb98ca651 service nova] Creating event network-vif-deleted:09ab977f-ac61-40dc-9c8c-c5bd31cbcbd8 for instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 on hv-cinder-85060 Jul 28 06:49:17.962363 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-67d2bd06-5fa1-4610-ba47-05d2744280d5 req-d3d79932-ce1c-46e6-8086-d9edb98ca651 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031663 Jul 28 06:49:17.963219 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 640/1271] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:49:17.973628 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-39c585e1-2914-4788-83d9-5012aad5b6ea tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:17.974404 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-39c585e1-2914-4788-83d9-5012aad5b6ea tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:17.980497 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-39c585e1-2914-4788-83d9-5012aad5b6ea tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:17.980931 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-39c585e1-2914-4788-83d9-5012aad5b6ea tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:17.981742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-39c585e1-2914-4788-83d9-5012aad5b6ea tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:17.983066 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-39c585e1-2914-4788-83d9-5012aad5b6ea tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:18.124416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-39c585e1-2914-4788-83d9-5012aad5b6ea tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:18.133796 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-39c585e1-2914-4788-83d9-5012aad5b6ea tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.164253 Jul 28 06:49:18.134367 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 632/1272] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:17 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:18.384852 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:18.385712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:18.393028 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:18.393513 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:18.394294 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:18.394866 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:18.439520 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:18.439981 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:18.440700 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lazy-loading 'fault' on Instance uuid 3b24ae82-f673-496a-99ba-e3e9e1056cc4 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:49:18.485693 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87b79d20f0f4194a99fc342c9b14aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f65f082a2547f79ac218e318bee171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:18.493530 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9883519c-150e-4b53-9b0e-a87e4820a6b8 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 200 len: 1328 microversion: 2.1 time: 0.114010 Jul 28 06:49:18.495918 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 641/1273] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:18 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 1328 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:19.155611 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-f3cab80c-1b6b-465c-93de-df338c10625a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:19.156155 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-f3cab80c-1b6b-465c-93de-df338c10625a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:19.162697 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3cab80c-1b6b-465c-93de-df338c10625a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:19.163151 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3cab80c-1b6b-465c-93de-df338c10625a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:19.163915 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3cab80c-1b6b-465c-93de-df338c10625a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:19.164350 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-f3cab80c-1b6b-465c-93de-df338c10625a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:19.301649 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-f3cab80c-1b6b-465c-93de-df338c10625a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:19.309951 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-f3cab80c-1b6b-465c-93de-df338c10625a tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.159004 Jul 28 06:49:19.310510 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 633/1274] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:19 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:19.515501 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5222fe9f-c00f-4d25-8d51-90fd64f6dad0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:19.516116 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5222fe9f-c00f-4d25-8d51-90fd64f6dad0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:19.522642 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5222fe9f-c00f-4d25-8d51-90fd64f6dad0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:19.523097 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5222fe9f-c00f-4d25-8d51-90fd64f6dad0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:19.523861 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5222fe9f-c00f-4d25-8d51-90fd64f6dad0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:19.524304 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5222fe9f-c00f-4d25-8d51-90fd64f6dad0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:19.538133 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-5222fe9f-c00f-4d25-8d51-90fd64f6dad0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] HTTP exception thrown: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5222fe9f-c00f-4d25-8d51-90fd64f6dad0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Request method failure captured: Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 HTTP/1.1 Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4jA4_TJKj8TbPC97s8mgpWwsijke7X2ZVfn8MmAHfp5l0LT74TiV-zjnxo2ZMG7Q78w-G5ZluZPD9aqSkeb6HEa5Rq49jRVR6oyGpg__xdsDwMkZRRQZwJix3uVbPR4_shYEsvxfylYrsJCI2VUv7LBJfPvkWhwycOdaGxuXO_3-vHs Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:49:19.539782 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0f65f082a2547f79ac218e318bee171", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}] Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: a87b79d20f0f4194a99fc342c9b14aa2 Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:19.541584 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '3b24ae82-f673-496a-99ba-e3e9e1056cc4'} Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:49:19.542609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:19.544244 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:19.545780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5222fe9f-c00f-4d25-8d51-90fd64f6dad0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Returning 404 to user: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:49:19.545780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5222fe9f-c00f-4d25-8d51-90fd64f6dad0 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 404 len: 111 microversion: 2.1 time: 0.030061 Jul 28 06:49:19.545780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 642/1275] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:19 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:49:19.554245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-0e04290f-90e6-4a94-9dbf-37eff269c11e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '.version_select at 0x7f5747611af0>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:19.572758 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-0e04290f-90e6-4a94-9dbf-37eff269c11e tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138029297" status: 202 len: 0 microversion: 2.1 time: 0.026299 Jul 28 06:49:19.573343 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 634/1276] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Jul 28 06:49:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138029297 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:49:20.331154 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-00f7be95-ba01-4e04-a8c9-75aaf02b75f2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:20.331762 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-00f7be95-ba01-4e04-a8c9-75aaf02b75f2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:20.338818 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-00f7be95-ba01-4e04-a8c9-75aaf02b75f2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:20.339269 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-00f7be95-ba01-4e04-a8c9-75aaf02b75f2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:20.340031 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-00f7be95-ba01-4e04-a8c9-75aaf02b75f2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:20.340469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-00f7be95-ba01-4e04-a8c9-75aaf02b75f2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:20.472616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-00f7be95-ba01-4e04-a8c9-75aaf02b75f2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:20.480250 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-00f7be95-ba01-4e04-a8c9-75aaf02b75f2 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.152957 Jul 28 06:49:20.480812 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 643/1277] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:20 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:21.502824 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-924654d2-e60a-4a0d-b7e8-92858087ceb0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:21.503421 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-924654d2-e60a-4a0d-b7e8-92858087ceb0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:21.509559 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-924654d2-e60a-4a0d-b7e8-92858087ceb0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:21.510008 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-924654d2-e60a-4a0d-b7e8-92858087ceb0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:21.510774 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-924654d2-e60a-4a0d-b7e8-92858087ceb0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:21.511210 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-924654d2-e60a-4a0d-b7e8-92858087ceb0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:21.644069 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-924654d2-e60a-4a0d-b7e8-92858087ceb0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:21.651596 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-924654d2-e60a-4a0d-b7e8-92858087ceb0 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.153443 Jul 28 06:49:21.652151 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 635/1278] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:21 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:22.444843 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-07eb6da2-c545-43a0-a69f-9f562b90cb35 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:22.445362 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-07eb6da2-c545-43a0-a69f-9f562b90cb35 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:22.447890 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:49:22.453927 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-07eb6da2-c545-43a0-a69f-9f562b90cb35 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:22.454373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-07eb6da2-c545-43a0-a69f-9f562b90cb35 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:22.455374 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-07eb6da2-c545-43a0-a69f-9f562b90cb35 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:22.455557 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-07eb6da2-c545-43a0-a69f-9f562b90cb35 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:22.472419 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-07eb6da2-c545-43a0-a69f-9f562b90cb35 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] HTTP exception thrown: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-07eb6da2-c545-43a0-a69f-9f562b90cb35 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Request method failure captured: Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: DELETE /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 HTTP/1.1 Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4jA4_TJKj8TbPC97s8mgpWwsijke7X2ZVfn8MmAHfp5l0LT74TiV-zjnxo2ZMG7Q78w-G5ZluZPD9aqSkeb6HEa5Rq49jRVR6oyGpg__xdsDwMkZRRQZwJix3uVbPR4_shYEsvxfylYrsJCI2VUv7LBJfPvkWhwycOdaGxuXO_3-vHs Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:49:22.473971 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0f65f082a2547f79ac218e318bee171", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}] Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: a87b79d20f0f4194a99fc342c9b14aa2 Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:22.475616 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '3b24ae82-f673-496a-99ba-e3e9e1056cc4'} Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:49:22.476499 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:22.477830 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:22.479173 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-07eb6da2-c545-43a0-a69f-9f562b90cb35 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Returning 404 to user: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:49:22.479173 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-07eb6da2-c545-43a0-a69f-9f562b90cb35 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 404 len: 111 microversion: 2.1 time: 0.034290 Jul 28 06:49:22.479173 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 644/1279] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:49:22 2022] DELETE /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:49:22.483834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e47cb6aa-37ba-4e5d-b5eb-16de682d25e1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:22.484472 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e47cb6aa-37ba-4e5d-b5eb-16de682d25e1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 3b24ae82-f673-496a-99ba-e3e9e1056cc4] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:22.490496 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e47cb6aa-37ba-4e5d-b5eb-16de682d25e1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:22.490944 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e47cb6aa-37ba-4e5d-b5eb-16de682d25e1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:22.491707 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e47cb6aa-37ba-4e5d-b5eb-16de682d25e1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:22.492146 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e47cb6aa-37ba-4e5d-b5eb-16de682d25e1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:22.505997 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-e47cb6aa-37ba-4e5d-b5eb-16de682d25e1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] HTTP exception thrown: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e47cb6aa-37ba-4e5d-b5eb-16de682d25e1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Request method failure captured: Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 HTTP/1.1 Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4jA4_TJKj8TbPC97s8mgpWwsijke7X2ZVfn8MmAHfp5l0LT74TiV-zjnxo2ZMG7Q78w-G5ZluZPD9aqSkeb6HEa5Rq49jRVR6oyGpg__xdsDwMkZRRQZwJix3uVbPR4_shYEsvxfylYrsJCI2VUv7LBJfPvkWhwycOdaGxuXO_3-vHs Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:49:22.507597 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0f65f082a2547f79ac218e318bee171", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}] Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: a87b79d20f0f4194a99fc342c9b14aa2 Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:22.509217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '3b24ae82-f673-496a-99ba-e3e9e1056cc4'} Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:49:22.510196 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. Jul 28 06:49:22.511853 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:49:22.513203 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e47cb6aa-37ba-4e5d-b5eb-16de682d25e1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Returning 404 to user: Instance 3b24ae82-f673-496a-99ba-e3e9e1056cc4 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:49:22.513203 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e47cb6aa-37ba-4e5d-b5eb-16de682d25e1 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4" status: 404 len: 111 microversion: 2.1 time: 0.028991 Jul 28 06:49:22.513203 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 636/1280] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:22 2022] GET /compute/v2.1/servers/3b24ae82-f673-496a-99ba-e3e9e1056cc4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:49:22.674472 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-8eb01e60-30d2-4b11-b719-20b76507d1b6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:22.675008 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-8eb01e60-30d2-4b11-b719-20b76507d1b6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:22.680978 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8eb01e60-30d2-4b11-b719-20b76507d1b6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:22.681469 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8eb01e60-30d2-4b11-b719-20b76507d1b6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:22.682229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8eb01e60-30d2-4b11-b719-20b76507d1b6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:22.682662 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-8eb01e60-30d2-4b11-b719-20b76507d1b6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:22.804619 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-df6cf566-aadf-483e-b3c6-c872f19e8b8a req-c7365d0a-78a5-4fb9-b773-c2413018c0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52742674-b180-42b2-8d0c-76e434454452", "name": "network-vif-plugged", "status": "completed", "tag": "3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:49:22.818904 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-df6cf566-aadf-483e-b3c6-c872f19e8b8a req-c7365d0a-78a5-4fb9-b773-c2413018c0e2 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:22.819920 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-df6cf566-aadf-483e-b3c6-c872f19e8b8a req-c7365d0a-78a5-4fb9-b773-c2413018c0e2 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:22.822039 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-8eb01e60-30d2-4b11-b719-20b76507d1b6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:22.833217 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-8eb01e60-30d2-4b11-b719-20b76507d1b6 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.163468 Jul 28 06:49:22.836919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-df6cf566-aadf-483e-b3c6-c872f19e8b8a req-c7365d0a-78a5-4fb9-b773-c2413018c0e2 service nova] Creating event network-vif-plugged:3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb for instance 52742674-b180-42b2-8d0c-76e434454452 on hv-cinder-85060 Jul 28 06:49:22.843314 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-df6cf566-aadf-483e-b3c6-c872f19e8b8a req-c7365d0a-78a5-4fb9-b773-c2413018c0e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044992 Jul 28 06:49:22.844613 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 637/1281] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:49:22.845856 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 645/1282] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:22 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:23.650744 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cb5d6bf9-9abd-4a04-8d13-9845bbeb526c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:23.651328 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-cb5d6bf9-9abd-4a04-8d13-9845bbeb526c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:23.653742 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:49:23.661083 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cb5d6bf9-9abd-4a04-8d13-9845bbeb526c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:23.661600 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cb5d6bf9-9abd-4a04-8d13-9845bbeb526c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:23.662405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cb5d6bf9-9abd-4a04-8d13-9845bbeb526c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:23.662841 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-cb5d6bf9-9abd-4a04-8d13-9845bbeb526c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:23.677616 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-cb5d6bf9-9abd-4a04-8d13-9845bbeb526c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] HTTP exception thrown: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cb5d6bf9-9abd-4a04-8d13-9845bbeb526c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Request method failure captured: Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: DELETE /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 HTTP/1.1 Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4jA4_TJKj8TbPC97s8mgpWwsijke7X2ZVfn8MmAHfp5l0LT74TiV-zjnxo2ZMG7Q78w-G5ZluZPD9aqSkeb6HEa5Rq49jRVR6oyGpg__xdsDwMkZRRQZwJix3uVbPR4_shYEsvxfylYrsJCI2VUv7LBJfPvkWhwycOdaGxuXO_3-vHs Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:49:23.679235 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0f65f082a2547f79ac218e318bee171", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}] Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: a87b79d20f0f4194a99fc342c9b14aa2 Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:49:23.680833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '75a696f5-5e72-43ab-ab80-76c7ff3a3266'} Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:49:23.681712 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:49:23.683084 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:49:23.684402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-cb5d6bf9-9abd-4a04-8d13-9845bbeb526c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Returning 404 to user: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:49:23.684402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-cb5d6bf9-9abd-4a04-8d13-9845bbeb526c tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 404 len: 111 microversion: 2.1 time: 0.034069 Jul 28 06:49:23.684402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 638/1283] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:49:23 2022] DELETE /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:49:23.690141 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-45902d59-9fc3-420b-a08c-144989e5e216 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:23.690999 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-45902d59-9fc3-420b-a08c-144989e5e216 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] [instance: 75a696f5-5e72-43ab-ab80-76c7ff3a3266] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:23.696898 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-45902d59-9fc3-420b-a08c-144989e5e216 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:23.697433 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-45902d59-9fc3-420b-a08c-144989e5e216 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:23.698187 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-45902d59-9fc3-420b-a08c-144989e5e216 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:23.698619 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-45902d59-9fc3-420b-a08c-144989e5e216 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:23.711779 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-45902d59-9fc3-420b-a08c-144989e5e216 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] HTTP exception thrown: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-45902d59-9fc3-420b-a08c-144989e5e216 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Request method failure captured: Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 HTTP/1.1 Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4jA4_TJKj8TbPC97s8mgpWwsijke7X2ZVfn8MmAHfp5l0LT74TiV-zjnxo2ZMG7Q78w-G5ZluZPD9aqSkeb6HEa5Rq49jRVR6oyGpg__xdsDwMkZRRQZwJix3uVbPR4_shYEsvxfylYrsJCI2VUv7LBJfPvkWhwycOdaGxuXO_3-vHs Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:49:23.713202 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0f65f082a2547f79ac218e318bee171", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0f65f082a2547f79ac218e318bee171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f65f082a2547f79ac218e318bee171"}]}] Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: f0f65f082a2547f79ac218e318bee171 Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-779766300 Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: a87b79d20f0f4194a99fc342c9b14aa2 Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-AttachVolumeTestJSON-779766300-project Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:49:23.714921 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '75a696f5-5e72-43ab-ab80-76c7ff3a3266'} Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:49:23.715732 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. Jul 28 06:49:23.717571 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:49:23.718746 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-45902d59-9fc3-420b-a08c-144989e5e216 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] Returning 404 to user: Instance 75a696f5-5e72-43ab-ab80-76c7ff3a3266 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:49:23.718746 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-45902d59-9fc3-420b-a08c-144989e5e216 tempest-AttachVolumeTestJSON-779766300 tempest-AttachVolumeTestJSON-779766300-project] 10.222.0.20 "GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266" status: 404 len: 111 microversion: 2.1 time: 0.028828 Jul 28 06:49:23.718746 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 646/1284] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:23 2022] GET /compute/v2.1/servers/75a696f5-5e72-43ab-ab80-76c7ff3a3266 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:49:23.856651 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-bcfb139d-d18f-4696-b1e9-df7cfb1e75d5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:23.857260 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-bcfb139d-d18f-4696-b1e9-df7cfb1e75d5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:23.863352 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bcfb139d-d18f-4696-b1e9-df7cfb1e75d5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:23.863800 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bcfb139d-d18f-4696-b1e9-df7cfb1e75d5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:23.864567 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bcfb139d-d18f-4696-b1e9-df7cfb1e75d5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:23.865014 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-bcfb139d-d18f-4696-b1e9-df7cfb1e75d5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:24.093245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-bcfb139d-d18f-4696-b1e9-df7cfb1e75d5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:24.100775 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-bcfb139d-d18f-4696-b1e9-df7cfb1e75d5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1575 microversion: 2.1 time: 0.247975 Jul 28 06:49:24.101612 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 639/1285] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:23 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:49:25.122746 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-5342760a-1fbf-44cb-b9fd-83620be07974 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:49:25.124516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-5342760a-1fbf-44cb-b9fd-83620be07974 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:49:25.131546 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5342760a-1fbf-44cb-b9fd-83620be07974 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:25.132292 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5342760a-1fbf-44cb-b9fd-83620be07974 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:25.133032 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5342760a-1fbf-44cb-b9fd-83620be07974 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:49:25.134095 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-5342760a-1fbf-44cb-b9fd-83620be07974 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:49:25.268940 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-5342760a-1fbf-44cb-b9fd-83620be07974 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:49:25.277709 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-5342760a-1fbf-44cb-b9fd-83620be07974 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1562 microversion: 2.1 time: 0.159563 Jul 28 06:49:25.278281 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 647/1286] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:49:25 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:13.815391 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-413643867", "imageRef": "cb311045-f5d4-4ec4-afa3-09a5a1a5cffc", "flavorRef": "452"}} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:50:13.823709 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=3 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:13.824432 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=68 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:13.870847 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.network.neutron [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] validate_networks() for None {{(pid=124562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:50:14.386883 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Flavor limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:50:14.387311 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Image limits 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:50:14.387784 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Flavor pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:50:14.388192 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Image pref 0:0:0 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:50:14.388601 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.virt.hardware [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:50:14.397643 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:14.398093 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:14.398899 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:14.399341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:14.416968 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Getting quotas for project 81acdc7886e0448bb4a413ee34bc612a. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:50:14.420966 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.quota [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Getting quotas for user e767b815733f4d708c57ef39d6516701 and project 81acdc7886e0448bb4a413ee34bc612a. Resources: {'ram', 'cores', 'instances'} {{(pid=124562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:50:14.432733 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Going to run 1 instances... {{(pid=124562) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:50:14.435006 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb311045-f5d4-4ec4-afa3-09a5a1a5cffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:50:14.478278 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-890fd9d3-0402-4a6e-9ab2-300c13b7fe30 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666823 Jul 28 06:50:14.478919 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 640/1287] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Jul 28 06:50:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:50:14.489671 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f27ce4fb-8ba6-43dd-b7a0-a57ac6aa078a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:14.491365 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f27ce4fb-8ba6-43dd-b7a0-a57ac6aa078a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:14.493421 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=7 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:14.494411 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:14.550108 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f27ce4fb-8ba6-43dd-b7a0-a57ac6aa078a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:14.559539 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f27ce4fb-8ba6-43dd-b7a0-a57ac6aa078a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1214 microversion: 2.1 time: 0.073778 Jul 28 06:50:14.560105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 648/1288] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:14 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:15.580697 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-9f5a4a9a-d1c6-4b37-8847-bd5c5be83add tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:15.581331 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-9f5a4a9a-d1c6-4b37-8847-bd5c5be83add tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:15.588375 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f5a4a9a-d1c6-4b37-8847-bd5c5be83add tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:15.588833 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f5a4a9a-d1c6-4b37-8847-bd5c5be83add tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:15.589643 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f5a4a9a-d1c6-4b37-8847-bd5c5be83add tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:15.590086 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-9f5a4a9a-d1c6-4b37-8847-bd5c5be83add tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:15.674723 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-9f5a4a9a-d1c6-4b37-8847-bd5c5be83add tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:15.683996 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-9f5a4a9a-d1c6-4b37-8847-bd5c5be83add tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1274 microversion: 2.1 time: 0.107889 Jul 28 06:50:15.686183 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 641/1289] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:15 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:16.708122 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-52728d08-52db-4634-a3ee-068836083894 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:16.709962 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-52728d08-52db-4634-a3ee-068836083894 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:16.717286 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-52728d08-52db-4634-a3ee-068836083894 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:16.718057 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-52728d08-52db-4634-a3ee-068836083894 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:16.718837 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-52728d08-52db-4634-a3ee-068836083894 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:16.719434 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-52728d08-52db-4634-a3ee-068836083894 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:16.857238 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-52728d08-52db-4634-a3ee-068836083894 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:16.866712 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-52728d08-52db-4634-a3ee-068836083894 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1314 microversion: 2.1 time: 0.162884 Jul 28 06:50:16.867027 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 649/1290] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:16 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:17.145663 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-c97c8b5e-675e-465f-91c1-7933bd67e3dc req-2b1a8c89-b9dc-4d8e-8fa5-9a29d1abbba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ac49a66-e2ba-4def-95b6-15fcd6088804", "tag": "b952d7fe-3941-4b71-89cc-cfaf4a4f43bf"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:50:17.171245 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-c97c8b5e-675e-465f-91c1-7933bd67e3dc req-2b1a8c89-b9dc-4d8e-8fa5-9a29d1abbba5 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:17.171693 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-c97c8b5e-675e-465f-91c1-7933bd67e3dc req-2b1a8c89-b9dc-4d8e-8fa5-9a29d1abbba5 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:17.186195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-c97c8b5e-675e-465f-91c1-7933bd67e3dc req-2b1a8c89-b9dc-4d8e-8fa5-9a29d1abbba5 service nova] Creating event network-changed:b952d7fe-3941-4b71-89cc-cfaf4a4f43bf for instance 3ac49a66-e2ba-4def-95b6-15fcd6088804 on hv-cinder-85060 Jul 28 06:50:17.194583 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-c97c8b5e-675e-465f-91c1-7933bd67e3dc req-2b1a8c89-b9dc-4d8e-8fa5-9a29d1abbba5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050933 Jul 28 06:50:17.195201 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 642/1291] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:50:17.886842 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ea050652-0da6-45d6-a25c-def51a0127ed tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:17.887447 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ea050652-0da6-45d6-a25c-def51a0127ed tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:17.893953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ea050652-0da6-45d6-a25c-def51a0127ed tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:17.894396 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ea050652-0da6-45d6-a25c-def51a0127ed tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:17.895148 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ea050652-0da6-45d6-a25c-def51a0127ed tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:17.895577 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ea050652-0da6-45d6-a25c-def51a0127ed tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:18.028648 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ea050652-0da6-45d6-a25c-def51a0127ed tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:18.036126 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ea050652-0da6-45d6-a25c-def51a0127ed tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1314 microversion: 2.1 time: 0.153187 Jul 28 06:50:18.037519 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 650/1292] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:17 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:19.058815 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4fe5984c-6a0e-473f-a52c-95eb8ac4fa44 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:19.059507 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4fe5984c-6a0e-473f-a52c-95eb8ac4fa44 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:19.067003 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4fe5984c-6a0e-473f-a52c-95eb8ac4fa44 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:19.067482 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4fe5984c-6a0e-473f-a52c-95eb8ac4fa44 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:19.068263 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4fe5984c-6a0e-473f-a52c-95eb8ac4fa44 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:19.068726 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4fe5984c-6a0e-473f-a52c-95eb8ac4fa44 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:19.205069 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-4fe5984c-6a0e-473f-a52c-95eb8ac4fa44 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:19.213598 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4fe5984c-6a0e-473f-a52c-95eb8ac4fa44 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1314 microversion: 2.1 time: 0.158890 Jul 28 06:50:19.214143 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 643/1293] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:19 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:20.234867 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-26e820c1-dd90-45de-9dd0-3218d53f8f47 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:20.235476 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-26e820c1-dd90-45de-9dd0-3218d53f8f47 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:20.242831 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26e820c1-dd90-45de-9dd0-3218d53f8f47 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:20.243284 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26e820c1-dd90-45de-9dd0-3218d53f8f47 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:20.244047 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26e820c1-dd90-45de-9dd0-3218d53f8f47 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:20.244489 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-26e820c1-dd90-45de-9dd0-3218d53f8f47 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:20.373131 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-26e820c1-dd90-45de-9dd0-3218d53f8f47 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:20.380517 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-26e820c1-dd90-45de-9dd0-3218d53f8f47 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1314 microversion: 2.1 time: 0.149554 Jul 28 06:50:20.381079 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 651/1294] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:20 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:21.401376 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-678ef0a4-3e8a-476d-bfc3-8c36e5e896fa tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:21.401990 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-678ef0a4-3e8a-476d-bfc3-8c36e5e896fa tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:21.408087 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-678ef0a4-3e8a-476d-bfc3-8c36e5e896fa tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:21.408540 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-678ef0a4-3e8a-476d-bfc3-8c36e5e896fa tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:21.409324 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-678ef0a4-3e8a-476d-bfc3-8c36e5e896fa tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:21.409765 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-678ef0a4-3e8a-476d-bfc3-8c36e5e896fa tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:21.540618 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-678ef0a4-3e8a-476d-bfc3-8c36e5e896fa tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:21.548258 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-678ef0a4-3e8a-476d-bfc3-8c36e5e896fa tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1314 microversion: 2.1 time: 0.150998 Jul 28 06:50:21.548831 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 644/1295] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:21 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:22.570502 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-f8a30663-35cc-4c04-a859-1eab9822c9f4 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:22.571092 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-f8a30663-35cc-4c04-a859-1eab9822c9f4 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:22.577641 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f8a30663-35cc-4c04-a859-1eab9822c9f4 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:22.578089 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f8a30663-35cc-4c04-a859-1eab9822c9f4 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:22.578843 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f8a30663-35cc-4c04-a859-1eab9822c9f4 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:22.579276 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-f8a30663-35cc-4c04-a859-1eab9822c9f4 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:22.717634 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-f8a30663-35cc-4c04-a859-1eab9822c9f4 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:22.724936 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-f8a30663-35cc-4c04-a859-1eab9822c9f4 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1314 microversion: 2.1 time: 0.158391 Jul 28 06:50:22.725516 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 652/1296] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:22 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:23.102438 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [req-df8940f3-f1b0-4db8-9ae5-a49fab7c8c11 req-eb4a719d-b375-423e-8315-9c61b562b82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac49a66-e2ba-4def-95b6-15fcd6088804", "name": "network-vif-plugged", "status": "completed", "tag": "b952d7fe-3941-4b71-89cc-cfaf4a4f43bf"}]} {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:50:23.114930 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-df8940f3-f1b0-4db8-9ae5-a49fab7c8c11 req-eb4a719d-b375-423e-8315-9c61b562b82b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:23.116253 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [req-df8940f3-f1b0-4db8-9ae5-a49fab7c8c11 req-eb4a719d-b375-423e-8315-9c61b562b82b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:23.129249 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.compute.server_external_events [req-df8940f3-f1b0-4db8-9ae5-a49fab7c8c11 req-eb4a719d-b375-423e-8315-9c61b562b82b service nova] Creating event network-vif-plugged:b952d7fe-3941-4b71-89cc-cfaf4a4f43bf for instance 3ac49a66-e2ba-4def-95b6-15fcd6088804 on hv-cinder-85060 Jul 28 06:50:23.135368 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [req-df8940f3-f1b0-4db8-9ae5-a49fab7c8c11 req-eb4a719d-b375-423e-8315-9c61b562b82b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036428 Jul 28 06:50:23.136001 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 645/1297] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:50:23.746203 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-73500801-cb93-4c8f-b7e1-dbf754397084 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:23.746812 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-73500801-cb93-4c8f-b7e1-dbf754397084 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:23.753572 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-73500801-cb93-4c8f-b7e1-dbf754397084 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:23.754026 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-73500801-cb93-4c8f-b7e1-dbf754397084 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:23.754820 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-73500801-cb93-4c8f-b7e1-dbf754397084 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:23.755384 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-73500801-cb93-4c8f-b7e1-dbf754397084 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:23.885965 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-73500801-cb93-4c8f-b7e1-dbf754397084 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:23.893383 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-73500801-cb93-4c8f-b7e1-dbf754397084 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1314 microversion: 2.1 time: 0.150996 Jul 28 06:50:23.893958 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 653/1298] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:23 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:24.914539 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-46b7333c-6083-4929-a127-a8edc8baa193 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:24.915237 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-46b7333c-6083-4929-a127-a8edc8baa193 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:24.917639 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=2 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:24.918417 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell0:SELECT=6 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:24.924163 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-46b7333c-6083-4929-a127-a8edc8baa193 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:24.924617 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-46b7333c-6083-4929-a127-a8edc8baa193 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:24.925402 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-46b7333c-6083-4929-a127-a8edc8baa193 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:24.925837 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-46b7333c-6083-4929-a127-a8edc8baa193 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:25.061219 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-46b7333c-6083-4929-a127-a8edc8baa193 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:25.069576 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-46b7333c-6083-4929-a127-a8edc8baa193 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1314 microversion: 2.1 time: 0.159123 Jul 28 06:50:25.070137 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 646/1299] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:24 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:26.090983 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-694ecd11-96f3-490e-aa3a-3ef08b09809a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:26.091544 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-694ecd11-96f3-490e-aa3a-3ef08b09809a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:26.093404 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell0:SELECT=2 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:26.099124 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-694ecd11-96f3-490e-aa3a-3ef08b09809a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:26.099590 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-694ecd11-96f3-490e-aa3a-3ef08b09809a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:26.100337 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-694ecd11-96f3-490e-aa3a-3ef08b09809a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:26.100775 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-694ecd11-96f3-490e-aa3a-3ef08b09809a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:26.230206 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-694ecd11-96f3-490e-aa3a-3ef08b09809a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:26.237609 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-694ecd11-96f3-490e-aa3a-3ef08b09809a tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1464 microversion: 2.1 time: 0.150611 Jul 28 06:50:26.238176 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 654/1300] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:26 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:26.281826 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-e13bb0c4-86f8-4199-b783-4b6ff6f6e8bf tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:26.282325 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e13bb0c4-86f8-4199-b783-4b6ff6f6e8bf tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:26.289685 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e13bb0c4-86f8-4199-b783-4b6ff6f6e8bf tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:26.290139 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e13bb0c4-86f8-4199-b783-4b6ff6f6e8bf tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:26.290902 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e13bb0c4-86f8-4199-b783-4b6ff6f6e8bf tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:26.291341 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-e13bb0c4-86f8-4199-b783-4b6ff6f6e8bf tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:26.318090 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-e13bb0c4-86f8-4199-b783-4b6ff6f6e8bf tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:50:26.391709 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-e13bb0c4-86f8-4199-b783-4b6ff6f6e8bf tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 204 len: 0 microversion: 2.1 time: 0.113362 Jul 28 06:50:26.392433 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 647/1301] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:50:26 2022] DELETE /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:50:26.400759 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-24cc309f-571c-4ea9-b823-7f4146a1e1a0 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:26.401429 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-24cc309f-571c-4ea9-b823-7f4146a1e1a0 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:26.407361 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-24cc309f-571c-4ea9-b823-7f4146a1e1a0 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:26.407806 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-24cc309f-571c-4ea9-b823-7f4146a1e1a0 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:26.408563 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-24cc309f-571c-4ea9-b823-7f4146a1e1a0 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:26.408992 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-24cc309f-571c-4ea9-b823-7f4146a1e1a0 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:26.538979 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-24cc309f-571c-4ea9-b823-7f4146a1e1a0 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:26.546425 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-24cc309f-571c-4ea9-b823-7f4146a1e1a0 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1470 microversion: 2.1 time: 0.149806 Jul 28 06:50:26.546995 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 655/1302] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:26 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:27.569837 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-2821236f-dfe7-42db-b2c5-dc7fac54e397 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:27.570541 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-2821236f-dfe7-42db-b2c5-dc7fac54e397 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:27.576984 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2821236f-dfe7-42db-b2c5-dc7fac54e397 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:27.577479 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2821236f-dfe7-42db-b2c5-dc7fac54e397 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:27.578244 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2821236f-dfe7-42db-b2c5-dc7fac54e397 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:27.578679 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-2821236f-dfe7-42db-b2c5-dc7fac54e397 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:27.712140 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-2821236f-dfe7-42db-b2c5-dc7fac54e397 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:27.719713 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-2821236f-dfe7-42db-b2c5-dc7fac54e397 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1470 microversion: 2.1 time: 0.155306 Jul 28 06:50:27.720284 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 648/1303] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:27 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:28.423432 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-9f29bfab-a65b-4eaa-ba0e-d9e8b0fe2b6b req-23e59534-27ef-491c-af5b-ead30fe0776b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac49a66-e2ba-4def-95b6-15fcd6088804", "name": "network-vif-deleted", "tag": "b952d7fe-3941-4b71-89cc-cfaf4a4f43bf"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:50:28.437188 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-9f29bfab-a65b-4eaa-ba0e-d9e8b0fe2b6b req-23e59534-27ef-491c-af5b-ead30fe0776b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:28.437807 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-9f29bfab-a65b-4eaa-ba0e-d9e8b0fe2b6b req-23e59534-27ef-491c-af5b-ead30fe0776b service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:28.452105 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-9f29bfab-a65b-4eaa-ba0e-d9e8b0fe2b6b req-23e59534-27ef-491c-af5b-ead30fe0776b service nova] Creating event network-vif-deleted:b952d7fe-3941-4b71-89cc-cfaf4a4f43bf for instance 3ac49a66-e2ba-4def-95b6-15fcd6088804 on hv-cinder-85060 Jul 28 06:50:28.458005 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-9f29bfab-a65b-4eaa-ba0e-d9e8b0fe2b6b req-23e59534-27ef-491c-af5b-ead30fe0776b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038855 Jul 28 06:50:28.459087 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 656/1304] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:50:28.742277 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:28.742900 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:28.749442 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:28.749893 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:28.750656 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:28.751094 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:28.781154 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:28.781633 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:28.782078 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.objects.instance [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lazy-loading 'fault' on Instance uuid 3ac49a66-e2ba-4def-95b6-15fcd6088804 {{(pid=124562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:50:28.827891 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767b815733f4d708c57ef39d6516701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81acdc7886e0448bb4a413ee34bc612a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:28.836005 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-d0c4ab51-8f5f-4dc2-a906-87a0ed5c33cd tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 200 len: 1304 microversion: 2.1 time: 0.098875 Jul 28 06:50:28.836570 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 649/1305] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:28 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:29.857228 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-03021f70-b4b5-411d-a99e-aa3ec80ea727 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:29.857997 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-03021f70-b4b5-411d-a99e-aa3ec80ea727 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] [instance: 3ac49a66-e2ba-4def-95b6-15fcd6088804] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:29.864705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03021f70-b4b5-411d-a99e-aa3ec80ea727 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:29.865697 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03021f70-b4b5-411d-a99e-aa3ec80ea727 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:29.866440 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03021f70-b4b5-411d-a99e-aa3ec80ea727 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:29.866875 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-03021f70-b4b5-411d-a99e-aa3ec80ea727 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:29.879725 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.wsgi [None req-03021f70-b4b5-411d-a99e-aa3ec80ea727 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] HTTP exception thrown: Instance 3ac49a66-e2ba-4def-95b6-15fcd6088804 could not be found. Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-03021f70-b4b5-411d-a99e-aa3ec80ea727 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Request method failure captured: Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: request: GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 HTTP/1.1 Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept: application/json Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Accept-Encoding: identity Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Connection: close Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Length: 0 Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Content-Type: application/json Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Host: 10.222.0.20 Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Openstack-System-Scope: None Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: User-Agent: python-urllib3/1.26.10 Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Auth-Token: gAAAAABi4jGkB0KNDLTVRu4AVgPMWKhV-1IdrXkOy20ZZRkMSU3Z5kctxXUdthadscaYC9d2UVrq2oGok1J4Eg8iv12aCtpNSGB1L3oamhAdv6hoghozaVJJdUT7MUm5rpWNCtWvMJaF97HfUeNHz8O45hBRiZLZkwcbKNUYqa-VfCg198ah-Rk Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Id: None Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Domain-Name: None Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Identity-Status: Confirmed Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Is-Admin-Project: True Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Id: default Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Domain-Name: Default Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Id: 81acdc7886e0448bb4a413ee34bc612a Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Project-Name: tempest-VolumesNegativeTest-2043593086 Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Role: member,reader Jul 28 06:50:29.881953 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Roles: member,reader Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_81acdc7886e0448bb4a413ee34bc612a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81acdc7886e0448bb4a413ee34bc612a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/81acdc7886e0448bb4a413ee34bc612a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81acdc7886e0448bb4a413ee34bc612a"}]}] Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant: tempest-VolumesNegativeTest-2043593086 Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Id: 81acdc7886e0448bb4a413ee34bc612a Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-Tenant-Name: tempest-VolumesNegativeTest-2043593086 Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User: tempest-VolumesNegativeTest-2043593086-project Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Id: default Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Domain-Name: Default Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Id: e767b815733f4d708c57ef39d6516701 Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: X-User-Name: tempest-VolumesNegativeTest-2043593086-project Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: method: > Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: exception: Instance 3ac49a66-e2ba-4def-95b6-15fcd6088804 could not be found. Jul 28 06:50:29.883847 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: action_args: {'id': '3ac49a66-e2ba-4def-95b6-15fcd6088804'} Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ac49a66-e2ba-4def-95b6-15fcd6088804 could not be found. Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:50:29.885164 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ac49a66-e2ba-4def-95b6-15fcd6088804 could not be found. Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ac49a66-e2ba-4def-95b6-15fcd6088804 could not be found. Jul 28 06:50:29.887093 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: ERROR nova.api.openstack.wsgi Jul 28 06:50:29.889204 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-03021f70-b4b5-411d-a99e-aa3ec80ea727 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] Returning 404 to user: Instance 3ac49a66-e2ba-4def-95b6-15fcd6088804 could not be found. {{(pid=124563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:50:29.889204 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-03021f70-b4b5-411d-a99e-aa3ec80ea727 tempest-VolumesNegativeTest-2043593086 tempest-VolumesNegativeTest-2043593086-project] 10.222.0.20 "GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804" status: 404 len: 111 microversion: 2.1 time: 0.030477 Jul 28 06:50:29.889204 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 657/1306] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:29 2022] GET /compute/v2.1/servers/3ac49a66-e2ba-4def-95b6-15fcd6088804 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:50:36.028965 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:50:36.029721 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Thu Jul 28 06:50:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:50:44.531181 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:50:44.531803 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Thu Jul 28 06:50:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:50:49.961772 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-63ccc60d-4d0e-4d08-9c52-db7ab1296096 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:49.962334 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-63ccc60d-4d0e-4d08-9c52-db7ab1296096 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:49.963790 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-1073dab8-d190-4323-a19d-1d4848918ddc req-54b603f9-86ca-4562-ac0f-bb67d4f919f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52742674-b180-42b2-8d0c-76e434454452", "tag": "3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:50:49.966356 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:49.967195 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG dbcounter [-] [124562] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:49.969106 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_api:SELECT=22 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:49.969910 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG dbcounter [-] [124563] Writing DB stats nova_cell1:SELECT=46 {{(pid=124563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:50:49.971151 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-63ccc60d-4d0e-4d08-9c52-db7ab1296096 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:49.971610 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-63ccc60d-4d0e-4d08-9c52-db7ab1296096 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:49.972448 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-63ccc60d-4d0e-4d08-9c52-db7ab1296096 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:49.973098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-63ccc60d-4d0e-4d08-9c52-db7ab1296096 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:49.977932 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-1073dab8-d190-4323-a19d-1d4848918ddc req-54b603f9-86ca-4562-ac0f-bb67d4f919f6 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:49.978373 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-1073dab8-d190-4323-a19d-1d4848918ddc req-54b603f9-86ca-4562-ac0f-bb67d4f919f6 service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:49.991752 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-1073dab8-d190-4323-a19d-1d4848918ddc req-54b603f9-86ca-4562-ac0f-bb67d4f919f6 service nova] Creating event network-changed:3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb for instance 52742674-b180-42b2-8d0c-76e434454452 on hv-cinder-85060 Jul 28 06:50:49.999347 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-1073dab8-d190-4323-a19d-1d4848918ddc req-54b603f9-86ca-4562-ac0f-bb67d4f919f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038793 Jul 28 06:50:49.999941 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 658/1307] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:50:50.003858 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-63ccc60d-4d0e-4d08-9c52-db7ab1296096 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Going to try to terminate instance {{(pid=124562) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:50:50.097505 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-63ccc60d-4d0e-4d08-9c52-db7ab1296096 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 204 len: 0 microversion: 2.1 time: 0.140102 Jul 28 06:50:50.098549 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 650/1308] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Jul 28 06:50:49 2022] DELETE /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:50:50.107274 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-9c0e4e50-fb0a-4df4-bc4d-4129093cdfd5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:50.107923 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-9c0e4e50-fb0a-4df4-bc4d-4129093cdfd5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:50.114695 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9c0e4e50-fb0a-4df4-bc4d-4129093cdfd5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:50.115141 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9c0e4e50-fb0a-4df4-bc4d-4129093cdfd5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:50.116458 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9c0e4e50-fb0a-4df4-bc4d-4129093cdfd5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:50.116888 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-9c0e4e50-fb0a-4df4-bc4d-4129093cdfd5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:50.254368 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-9c0e4e50-fb0a-4df4-bc4d-4129093cdfd5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:50.262705 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-9c0e4e50-fb0a-4df4-bc4d-4129093cdfd5 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.159864 Jul 28 06:50:50.263511 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 659/1309] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:50 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:51.285217 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-95eff353-8d7c-4549-a336-62bfafe36c93 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:51.285937 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-95eff353-8d7c-4549-a336-62bfafe36c93 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:51.292452 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-95eff353-8d7c-4549-a336-62bfafe36c93 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:51.292895 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-95eff353-8d7c-4549-a336-62bfafe36c93 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:51.293682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-95eff353-8d7c-4549-a336-62bfafe36c93 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:51.294110 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-95eff353-8d7c-4549-a336-62bfafe36c93 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:51.499171 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-95eff353-8d7c-4549-a336-62bfafe36c93 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:51.507812 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-95eff353-8d7c-4549-a336-62bfafe36c93 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1568 microversion: 2.1 time: 0.226821 Jul 28 06:50:51.508373 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 651/1310] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:51 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:52.516088 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [req-bf350576-d6b5-49ab-86bb-413574039251 req-051b7a3b-97ce-4736-9162-8445fb5518fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52742674-b180-42b2-8d0c-76e434454452", "name": "network-vif-deleted", "tag": "3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb"}]} {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:50:52.526993 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-bf350576-d6b5-49ab-86bb-413574039251 req-051b7a3b-97ce-4736-9162-8445fb5518fc service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:52.527443 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [req-bf350576-d6b5-49ab-86bb-413574039251 req-051b7a3b-97ce-4736-9162-8445fb5518fc service nova] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:52.529030 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-1609a1cb-d5fd-4985-9f58-cf9e7650792c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:52.529682 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-1609a1cb-d5fd-4985-9f58-cf9e7650792c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:52.536428 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1609a1cb-d5fd-4985-9f58-cf9e7650792c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:52.536995 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1609a1cb-d5fd-4985-9f58-cf9e7650792c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:52.538416 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1609a1cb-d5fd-4985-9f58-cf9e7650792c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:52.538975 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-1609a1cb-d5fd-4985-9f58-cf9e7650792c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:52.539691 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.compute.server_external_events [req-bf350576-d6b5-49ab-86bb-413574039251 req-051b7a3b-97ce-4736-9162-8445fb5518fc service nova] Creating event network-vif-deleted:3b6224bb-c664-4c4a-8ad9-6e0cbd5220fb for instance 52742674-b180-42b2-8d0c-76e434454452 on hv-cinder-85060 Jul 28 06:50:52.544751 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [req-bf350576-d6b5-49ab-86bb-413574039251 req-051b7a3b-97ce-4736-9162-8445fb5518fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032373 Jul 28 06:50:52.545556 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 660/1311] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 28 06:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:50:52.606051 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.policy [None req-1609a1cb-d5fd-4985-9f58-cf9e7650792c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:52.613714 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-1609a1cb-d5fd-4985-9f58-cf9e7650792c tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1381 microversion: 2.1 time: 0.088662 Jul 28 06:50:52.614291 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 652/1312] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:52 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1381 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:50:53.637288 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:53.637982 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.compute.api [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124563) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:53.644566 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:53.645009 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:53.645798 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:53.646229 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:53.679955 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:53.680397 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG oslo_concurrency.lockutils [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:53.680863 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.objects.instance [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lazy-loading 'fault' on Instance uuid 52742674-b180-42b2-8d0c-76e434454452 {{(pid=124563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:50:53.727552 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.policy [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52586f7b50964ec7ae104a04e9be3004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e705818597064414b9d882e0dd2071c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124563) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:50:53.734990 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-ab9ed807-fa66-4a52-833c-ace2ee29894e tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 200 len: 1223 microversion: 2.1 time: 0.102629 Jul 28 06:50:53.735546 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 661/1313] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:53 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:50:54.757347 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4a57adc0-f112-48b6-8539-8b86117f2b03 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '>' {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:54.757957 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.compute.api [None req-4a57adc0-f112-48b6-8539-8b86117f2b03 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] [instance: 52742674-b180-42b2-8d0c-76e434454452] Fetching instance by UUID {{(pid=124562) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:50:54.764396 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4a57adc0-f112-48b6-8539-8b86117f2b03 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:54.764834 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4a57adc0-f112-48b6-8539-8b86117f2b03 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:54.765616 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4a57adc0-f112-48b6-8539-8b86117f2b03 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:50:54.766044 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG oslo_concurrency.lockutils [None req-4a57adc0-f112-48b6-8539-8b86117f2b03 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Lock "a6e3eabf-f037-414e-9584-b60d50f4a3c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:50:54.779775 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.wsgi [None req-4a57adc0-f112-48b6-8539-8b86117f2b03 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] HTTP exception thrown: Instance 52742674-b180-42b2-8d0c-76e434454452 could not be found. Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4a57adc0-f112-48b6-8539-8b86117f2b03 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Request method failure captured: Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: request: GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 HTTP/1.1 Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept: application/json Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Accept-Encoding: identity Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Connection: close Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Length: 0 Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Content-Type: application/json Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Host: 10.222.0.20 Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Openstack-System-Scope: None Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: User-Agent: python-urllib3/1.26.10 Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Auth-Token: gAAAAABi4jCnY_bv5RSmqDpCPjBa8s1CJc7Bu2RpA3ASJqdSzXR_aNEP_V87JwwJH6d7cz4urfDuVuF1i7dgTOtVh1H39TBQ0NTGxNav2uQoF-Vp7bueNdLQVuJd2OLgCCVooxrOrSut_bOe9gwfvphaDq9O7I5AF3Mv_YZaVNwQoTgfjeUAFVA Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Id: None Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Domain-Name: None Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Identity-Status: Confirmed Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Is-Admin-Project: True Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Id: default Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Domain-Name: Default Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Id: e705818597064414b9d882e0dd2071c2 Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Project-Name: tempest-TestShelveInstance-177597828 Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Role: member,reader Jul 28 06:50:54.781405 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Roles: member,reader Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e705818597064414b9d882e0dd2071c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e705818597064414b9d882e0dd2071c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e705818597064414b9d882e0dd2071c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e705818597064414b9d882e0dd2071c2"}]}] Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant: tempest-TestShelveInstance-177597828 Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Id: e705818597064414b9d882e0dd2071c2 Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-Tenant-Name: tempest-TestShelveInstance-177597828 Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User: tempest-TestShelveInstance-177597828-project Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Id: default Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Domain-Name: Default Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Id: 52586f7b50964ec7ae104a04e9be3004 Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: X-User-Name: tempest-TestShelveInstance-177597828-project Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: method: > Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: exception: Instance 52742674-b180-42b2-8d0c-76e434454452 could not be found. Jul 28 06:50:54.783247 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: action_args: {'id': '52742674-b180-42b2-8d0c-76e434454452'} Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: {{(pid=124562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52742674-b180-42b2-8d0c-76e434454452 could not be found. Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:50:54.784422 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52742674-b180-42b2-8d0c-76e434454452 could not be found. Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52742674-b180-42b2-8d0c-76e434454452 could not be found. Jul 28 06:50:54.786499 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: ERROR nova.api.openstack.wsgi Jul 28 06:50:54.788372 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: DEBUG nova.api.openstack.wsgi [None req-4a57adc0-f112-48b6-8539-8b86117f2b03 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Returning 404 to user: Instance 52742674-b180-42b2-8d0c-76e434454452 could not be found. {{(pid=124562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:50:54.788372 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO nova.api.openstack.requestlog [None req-4a57adc0-f112-48b6-8539-8b86117f2b03 tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452" status: 404 len: 111 microversion: 2.1 time: 0.030044 Jul 28 06:50:54.788372 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: [pid: 124562|app: 0|req: 653/1314] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Jul 28 06:50:54 2022] GET /compute/v2.1/servers/52742674-b180-42b2-8d0c-76e434454452 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:50:54.947707 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: DEBUG nova.api.openstack.wsgi [None req-68eb66af-2a3a-459d-b9f8-7247368e03fe tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] Calling method '.version_select at 0x7f574c1e8a60>' {{(pid=124563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:50:54.970080 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO nova.api.openstack.requestlog [None req-68eb66af-2a3a-459d-b9f8-7247368e03fe tempest-TestShelveInstance-177597828 tempest-TestShelveInstance-177597828-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-593095002" status: 202 len: 0 microversion: 2.1 time: 0.026844 Jul 28 06:50:54.970780 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: [pid: 124563|app: 0|req: 662/1315] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Jul 28 06:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-593095002 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:52:16.752985 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:52:16.754041 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Thu Jul 28 06:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:53:56.037460 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:53:56.037970 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Thu Jul 28 06:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:54:04.539426 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:54:04.539959 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Thu Jul 28 06:54:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:55:36.762098 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:55:36.762703 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Thu Jul 28 06:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:55:46.561209 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:55:46.561803 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Thu Jul 28 06:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:56:02.479535 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:56:02.480091 dv-cinder-850605-1-iscsi devstack@n-api.service[124562]: Thu Jul 28 06:56:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:56:05.001070 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:56:05.001720 dv-cinder-850605-1-iscsi devstack@n-api.service[124563]: Thu Jul 28 06:56:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!